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EDITOR’S INTRODUCTION 


Up to very recently the quality of instruction given by n 
teacher has been almost entirely a matter of personal opin¬ 
ion. A teacher was good, average, or poor, largely as he or 
she impressed a principal or supervisor; and the basis for 
estimating these qualities lay largely in the theory as to the 
nature of the educational process possessed by the sui>er- 
visory ofBcer. To a superintendent of the drill and memo¬ 
rization and martinet type, a creative and stimulative and 
original teacher probably y^ould be classed M poor; whereas 
such a teacher-would be highly prized by a suiwrintendent 
in close sympathy with the creative and expressive tenden¬ 
cies in modem education. Against such personal opinion the 
teacher has had almost no means of defense. On tljo other 
hand, it has been almost equally difficult for a superin¬ 
tendent to demonstrate to questioning laymen wherein the 
work of a teacher lacked effectiveness. 

Within recent years a number of personal-estimate scales 
have been devised by students and superintending officers 
for chartmg, in visual form, the important characteristics 
of teachers. Such charts have been useful in rcvcalmg j>omta 
of strength and weakness, both to teachers and to super* 
visory officers. 

Practically within the past five years an entirely new series 
of instruments for estimating teaching efficiency has been 
made available in the form of the new Standarrlized Teats, 
with their accompanying Standard Scores and Score Charts. 
It is with this new set of measuring tools that this volume 
deals. Much of the early work in evolving and standardizing 
these new measuring scales, and accumukting results from 
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which to work out the Standard Scores, naturally had to be 
quite technical and was hard for the teacher to understand. 
Enough such work has now been done to enable the author 
of this volume to organize and present, in simple and read¬ 
able form, the essential information needed by grade teachers 
to enable them to use these Standardized Tests to measure 
and determine for themselves the efiFectiveneas of their own 
instruction, what are the points of strength and weakness in 
the work they are doing, and where they should add empha¬ 
sis and where enough emphasis has been placed. The years 
of important work done by the author in directing the 
teachers of the State of Kansas in estimating and evaluatmg 
the work of the Kansas schools should in itself insure a 
helpful volume. 

The value of such a book as this one to the teacher in 
service cannot but be large. It is seldom that books of such 
definiteness axe written for the use of teachers. A study and 
mastery of the method of this volume mean the acquirement 
of a new tool for estimating personal efficiency and self- 
improvement. The use of the Tests means a new ability to 
diagnose and prescribe. To the work of the teacher in the 
classroom they give a definiteness heretofore imknown. To 
use a militaiy term, they set the “limited objectives” for 
each subject of the course of study, which the teaclier is 
expected to reach, but beyond which she is not expected to 
go, They prevent a waste of teaching energy by preventing 
over-emphasis, and set standards in instruction which are 
indisputable because they are based on the school practice 
of the best schools of the United States. By their use teach¬ 
ers may determine their own efficiency, compare the prog¬ 
ress of their pupils or class, with pupils or classes elsewhere 
in terms that are definite and measures that are comparable; 
and, if unjustly criticized, they can defend the work they are 
doing. The new Standardized Teats give a definitenesa and 
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scientific accuracy to the work of schoolroom instruction 
heretofore unknown, and teachers in all kinds of school sys¬ 
tems will be benefited by a careful study of this imjx)rtant 
volume. , 


Ellwood I’. Cubherust 




PREFACE 


This book is written for the teacher in the elementary 
school. As such it is not intended to be a fundamental 
treatise upon educational measurements, but rather a text 
which will help teachers to use standardized testa to the 
greatest advantage. Only certain ones of the available 
standardized tests are described. This was thought to be 
a more helpful plan than to include all of the available 
tests, because the elementary teacher seldom has at hand 
the information necessary for an intelligent selection of 
standardized tests. The value of a number of the tests 
described in this text has t>een demonstrated by wide usage. 
Others are just being made available for use. In these coses 
it has been necessary for the author to exercise his judgment 
based upon four years’ experience in supplying tests to 
teachers and superintendents through the Bureau of Edu-* 
cational Measurements and Standards of the Kansas State 
Normal School, Emporia, Kansas. Some worthy tests have 
been omitted partly because of the limitations of space 
and partly because of other considerations. Other worthy 
testa will doubtless be devised in the future, some of them 
replacing certain of the tests chosen for description in this 
text. I 

The feasibility of the test being used by teachers who 
have not had special training in the field of cducJitionol nicoa* 
ureraents has been kept constantly in mind. Detailed di¬ 
rections for the use of a test arc generally not reproduced, 
for they are furnished with the test when purchased for class 
use. Only those general features which are necessary for 
understanding the tests and the method of handling the 
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results have been given. It is believed that any te".<3her who 
studies carefully the descriptions given in this text will have 
no difficulty in using any of the tests described. 

It is the contention of the author that the use of a stand¬ 
ardized test is justified only when the teacher can use the 
resulting measures as a basis for improving instruction. 
Consquently much space is given to the interpretation of 
scores or measures and the corrective instruction which 
should be given to correct unsatisfactory scores. Unfortu¬ 
nately little is known about corrective measures for certain 
school subjects. This, however, is a condition which time 
will remedy. 

The author is aware that in a sense he has done little more 
than bring together the results of a number of workers in 
this field and he realizes his indebtedness to them, He 
is particularly indebted to Dean F. J, Kelly and Captain 
J. C. DeVoss who kindly permitted him to use portions of 
their chapters in Educational Tests and Measurmmis. 


Blodionqton, Imduna 


Walteb S. Monrob 
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MEASUKING 

THE RESULTS OF TEACHING 

CHAPTER I 

THE INACCURACY OP PRESENT SCHOOL MARKS 

The measuremeiit of results not new in education. Edu¬ 
cational measurements axe not new in school work, although 
this name has not been applied to them until very recently, 
Since scliools have existed, teachers and other school offi¬ 
cials have attempted to measure the abilities of pupils by 
estimating daily recitations and by examinations, The 
measures of the abilities of pupils obtained in tliese ways 
are tliought to possess a liigh degree of precision and ore 
considered very important. 

The promotion of pupils depends upon the “ grades " tlicy 
receive. The ability of a pupil in each of the subjects is 
measured by the teacher’s estimate and by examination, 
and if the resulting measiues show the pupil to l>e a few 
points, or in some instances a fraction of a point i)elow the 
“passing mark,” the pupil is classified ns a failure. If the 
resulting measures equal or ore above the " passing mark," 
the pupil is promoted. 

The “grades” or school marb are entered ujwn tlie 
monthly or quarterly report cards. Parents, as well m 
teachers and pupils, take these school marks very seriously. 
If Johnnie’s “grades” for a given month are Mow tliose of 
the preceding months, or, worse still, if they arc Mow tliose 
of neighbor Smith’s Mary, an explanation is demanded. A 
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permanent record is kept of at least the yearly “grades,” 
and the awarding of school honors is based upon it. 

Until recently, practically all admission to college was 
determined by examination. Except in the universities 
and colleges of the Central and Western American States, 
the custom still maintains generally throughout tlic world. 
This practice is based on the assumption that the examining 
committee can determine thereby the effectiveness of the 
candidate’s college preparatory work. The civil service, 
from its inception in China centuries ago until the present 
day, has employed the examination as a means for meas¬ 
uring the ability of persons who desire positions operated 
under this system. 

The use of scientific tests and standards is new. Although 
the measurement of the results of instruction is not new, it 
should be recognized that the use of tests which have been 
scientifically constructed and the interpretation of the re¬ 
sulting measures by comparison with standards is one of 
the most recent educational developments. Thorndike, “ the 
father of this movement,” has discovered what is probably 
the earliest record of this new type of educational measure¬ 
ment. The date of this publication, which was by an English 
Bchoolm^ter, is 1864. In our own country, Rice’s report on 
spelling in 1897 marked the beginning of the movement, but 
except for this and a few other pioneer efforts, tlie develop¬ 
ment has been confined to the last ten years. Within this 
period those who ridiculed the work of Rice have been 
converted to educational measurements, and standardized 
tests are now generally recognized as one of the most help¬ 
ful msHuments at the command of the teacher and the 
supervisor. 

Recent investigations have shown school marks to be In¬ 
accurate. One of the most important factors contributing 
to our present use of standardized tests has been a number 
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of investigations made to ascertain the accuracy or rclial>il- 
ity of measui'cs obtained by means of teachers’ estimates 
and by means of examinations. In llie world of physical 
things we measure distance by means of the yardstick, mas-s 
by means of scales, the volume of liquids by means of gallon 
measures. Measurements of these magnitudes, when made 
carefully witli accurate instruments, ix)sse.s.s a high degree 
of reliability. By a high degree of reliability wc mean, for 
example, that if two persons measure the length of the same 
room by means of the some yardstick or any other yard¬ 
stick, the two measurements will be approximately equal. 
If they differ by more than one or two inches, we doubt the 
acem-aey of botli, and we demand that die room be measured 
again. Similarly, in the case of school-children, if we find 
that, when tlie same children are measured in the same sul)- 
jects by two different teachers, tlie two sets of measures do 
not agree rather closely, we have reason to doubt the accu¬ 
racy of both sets of measures. On the other hand, if the two 
sets of measures (“grades”) agree closely, we have reason 
to believe them accurate or reliable. 

In this chapter we present evidence from tlirce types of 
investigations which show that marks given by teachers 
under ordinary conditions are not accurate measures of Uie 
abilities of their pupils: (1) Kelly’s investigation based upon 
the final “grades ” given to pupils in two 8ucce.ssive years by 
different teacliers; (2) Johnson’s investigation baaed upon 
the distribution of “grades”; (3) the marking of examintt' 
tion papers. 

(I) Kelly’a irwestigolim. In 1013, Kelly ^ made on inves¬ 
tigation of the marks given to the sixth-grade pupils in four 
ward schools in Hackensack, New Jersey, and tlie marks 
given to the same pupils when they went to a common 

* Kelly, P. J.. Teachers' Marks. (Teaohera College ContribuUona to 
Education, no. 66, p. 7.) 
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departmental school for seventh-grade work. This will be 
recognized as a case where the abilities of the same pupils 
were measured by two different seta of teachers, the sixth- 
grade teachers in the ward schools and the seventh-grade 
teachers in the departmental school. Since in the depart¬ 
mental school all of the pupils were taught arithmetic by 
one teacher, there was an opportunity to compare the 
“grades” given in arithmetic by the sixth-grade teacliers in 
the different ward schools. If these teachers were accurate 
in their “grading,” we would expect to find that all of the 
pupils who received a mark of “G” (good) in arithmetic in 
the sixth grade would receive approximately the same mark 
in the seventh grade. If, however, the sixth-grade teachers 
were inaccurate in their marking, —that is, some of them 
marked too high or too low, — we would expect to find that 
pupils having the mark of “G” in the sixth grade, but com¬ 
ing from different schools, would, on the average, receive 
different marks in the seventh grade. This condition was 
found to exist. 

Kelly states his conclusions as follows: 

This means that for work which the teacher in school “C” (one 
of the ward schools) would give a mark of “ G” (good) in language, 
penmanship, or history, the teacher in school “D” (another word 
school) would give less than a mark "P” (fair). 

(^) Johnson's invesiigaHon. Another type of investiga¬ 
tion has been made by Johnson, ‘ Principal of the University 
High School of the University of Chicago, It is based upon 
the fact that when accurate measurements are made of any 
ability of a large group of pupils, the resulting measures are 
distributed; that is, arranged along the scale of measurement, 
in a certain definite way. For example, in Fig. 1 there are 

* Johnson, F. W.. “A Study of High School Gmdes”; in School Review, 
vol. 19, pp, 13-24. See also Kelly. F. J.. Teachers’ Marks, p. 11, and foUow- 
ing, for reports of si milar investigations. 
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represented graphically four distributions of the measures 
of silent reading ability secured by giving the Kansas Silent 
Heading Tests. The number of measures represented in 
each grade is over 5000. The base line of the curve in each 



Fra. 1. Showing thb DiBrarntmoN or MEASOTiia or Siubnt RaAowa 
AbIUTT as MBASnBKD BY THB KANSAS SlUCNT BJOADINO TbsTO. 


case represents the scale of the test, 0,1, 2,3,4, 5, and so on. 
At any point of this base line the height of the broken line 
curve above the base line represents the numlier of pupils 
having the measure represented. The general shape of tliese 
four broken line curves is the same. A few pupils received 
very low measures and a few very high ones. The great 
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majority of the measures axe grouped near the middle where 
the curve is highest. A curve which, begiiming with the 
low measures, rises gradually and then falls gradually, as do 
those shown in Pig. 1, is called a “normal curve” and rep-, 
resents the shape of the distribution when accurate mcos^ 
urements have been made. If the shai)e of Hie curve repre¬ 
senting the distribution of a particular set of measures dif¬ 
fers materially from the general shape of the curves in Pig. 1 , 
there is reason for questioning the accuracy of the measures. 

In the University High School, “P” denotes failure, and 
the four successive ranlts above failure are indicated by 
“D,” “C,” “B,” and "A.” For the several departments of 
the school, Johnson tabulated the number of times each 
mark was given during the years 1907-08 and 1908-09. 
The conditions which he found to exist may be illustrated 
by Fig. The upper figure shows the distributions of 
marks in English (left) and history (right). It will lie noted 
that in the case of English a much larger proportion of low 
marks (“F” and “D”) were given than in history. For the 
high marks (“A” and “B”) just the reverse is true. Both 
curves fail to conform closely to the normal curve described 
above which suggests that the marks may not represent 
accurate measures. 

However, the most striking part of the figure is the lower 
which represents the distributions of tlie marks of two teach¬ 
ers in the same department. The distribution for teacher A 
conforms reasonably dose to the normal curve, but that for 
teacher B departs from it in a very conspicuous fashion. It 
is obvious that teacher B is accustomed to give “high 
grades.” In so doing he has furnished evidence that his 
marks are probably inaccurate. 

^ {3) Marking examination ■papers. The written examina¬ 
tion is the most common means of measuring the abilities 
of pupils, although many teachers and school patrons oppose 
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its use. They contend that pupils working under pressure 
frequently become nervous and confused and consequently 
cannot do themselves justice, while other pupils, who have 
no real grasp of the subject, are able by cramming to write 




r D C B A 


History 


r D c B A 


Teacher A 


F o C B A 


Teacher h I 



P D- C B A 
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{After Johnaon.) 


excellent papers. It is also contended that the qucsUon.s are 
frequently not well selected and do not pertain to the essen¬ 
tials of the subject. 

There is probably some truth in the above assertions, but 
within the past few years there have been a numlier of in¬ 
vestigations to ascertain if teachers mark examination 





8 MEASUEING THE RESULTS OF TEACHING 

papers accurately, assuming that what appears on the papers 
is a true record of the abilities of the pupils. Starch and 
Elliott* mvestigated the accuracy with which teachers 
marked papers in English, geometry, and history. Their 
method and the facts revealed may be illustrated by the 
case of geometry. 

A f fif^aiTTiile reproduction was made of an actual examina¬ 
tion paper in plane geometry, A copy of this reproduction 
was sent to each of the high schools included in the Nortli 
Central Association of Colleges and Secondary Schools, witli 
the request that it be marked on the scale of one hundred 
per cent by the teacher of geometry. The teacher was asked 
to mark the paper by the method he was accustomed to use. 
Papers were returned from 116 schools, and the results tub¬ 
ulated. When we consider that tlie subject-matter of geom¬ 
etry is quite definite, and that the papers were marked by 
teachers who were thoroughly acquainted with the subject, 
. it would seem that we might expect the marks or “grades” 
placed upon this examination paper to be in close agree¬ 
ment. However, exactly the opposite was the case. 

Distribution of marks. The distribution of the marks is 
shown in Fig. 3. The scale is marked on the base lino and 
the number of dots above any point indicates the number 
of teachers who gave the indicated “grade.” Thus the 
“grade” of 75 was given by thirteen teachers, the "grade” 
of 76 by three teachers, and so on. Of the 116 marks, two 
were above 90, while one was below 30. Twenty were 80 
or above, while twenty other marks were below 60. Forty- 
seven teachers assigned a mark passing or above, while 
sixty-nine teachers thought the paper not worthy of a 
passing mark. 

* Starch, and Elliott. “Reliability of Grading High-School Work in 
English”: in School Rwim, vol. 20, pp. 442-57; ‘‘Reliability of Grading 
Work in Mathematics”; in School Bemew, vol. 21, pp. 264-59; "Reliability 
of Grading Work in History”; in School Review, vol. 21, pp. 676-81. 
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Not only were similar results obtained by Starch and El¬ 
liott in English and in history, but other investigators ^ 
have verified them many times. In the face of such facts 
only one conclusion is possible; namely, that under ordinary 
conditions the marks assigned to examination pnjKsrs by 
teachers are very unreliable. Such marks can represent only 
very crude and very inaccurate measures of the abilities of 
pupils. It is not too much to say that the mark which a 


28 63 66 60 66 70 76 60 86 00 

Fig. 8. Distkidction of Marks assigned to one Geometry Paper dy 
110 1'eaciieus.- 

Ftuflliig grade Ilango 28 to 02. Marks assigned by schools whoso passing grade was 70 
woro weighted by 9 points. Median 70. Probable error 7.0. 

pupil receives on an examination paper dejiends upon the 
teacher who “grades” tlie pajier, as well as ujion 6vhat tho 
pupil places upon the pajier. 

It has also been shown that the same teacher is not con¬ 
sistent in his own marking. If a set of papers arc marked a 
second time, tlie two seta of marks will vary widely.® 
Summary, We have now presented an illustration of oacli 
of three types of evidence tliat teachers’ marks, both final 
“grades” and examination “grades,” arc inaccurate. In 
each case the illustration is typical of a number of similar 
ones which might be mentioned. We have, therefore, a 

* See Kelly, P. J., Teachers' Marks, p. Cl, and following, for accounts of 
other investigations. 

* See Starch, Daniel, Educational Measurements, p. 0. 
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fljuomi't of Gvidciicc Uifll tGfl-cliGrs merles s^rc not 
curate. We sti»ll next consider two causes for tlie errors in 
marking examination papers. 

Conditions which contribute to the inaccuracy in marking 
examination papers. (I) Error due to unequal value of ques¬ 
tions, A critical study of examinations and of tlic manner 
of giving them reveals certain conditions which contribute 
to the inaccuracy in teachers’ marks. In the first place, tlio 
que.stions are generally considered equal in value, but if we 
judge the value of questions on the basis of tlieir difficulty 
as shown by the responses of the pupils, it i.s seldom that 
the same credit should be given for answering correctly two 
diSerent questions. As evidence of tliis consider tire follow¬ 
ing questions taken from an examination in United States 
history.^ The number following the question is the i)er cent 
of pupils who answered the question correctly. 


To what religious body did most of the settlers of Penn¬ 
sylvania belong?..... 02.3 

What critical problem arose during Buchanan’s adminis¬ 
tration? . 7.0 

What is the main purpose of the Monroo Doctrine?.25.5 


These differences in the per cent of correct answers are 
merely typical of what is very likely to be the case in any 
examination prepared by the teacher. The questions will 
not be equally difficult, and it is the general practice to base 
the credit given for a correct answer upon the difficulty of 
the question: that is, less credit is given for answering cor¬ 
rectly an “easy” question than for a “hard” one. 

It is easy to understand how a serious element of error is 
introduced when each question is considered to have a value 
of ten points and the questions are not equal in difficulty. 

' Buckingham, B. R., “Survey of the Gary and Prevocational Schools,” 
Seoenteenih Annual Beyoti qf the Ciiy Superintendml of Schools (New York 
City), 1014-16. 
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The situation is much the same as we should have in meas¬ 
uring distances if yardsticks of different lengths were used, 
but were considered to be equal. Under such circumstances 
a yard would have no definite length, and to say that a cer¬ 
tain distance was 21.42 yards would convey no definite in¬ 
formation about it. For this reason the Federal Government 
has standardized all weights and nieiusures by c.stabli.sliing 
definite units, and before we can obtain definite measures of 
the abilities of children, it will be necessary to devise tests 
consisting of standard units: that is, tlic questions or exer¬ 
cises composing the test must be evaluated. 

A teacher's estimale of the difjicuUy of questions is unre¬ 
liable. Can a teacher judge of the difficulty of a problem or 
even arrange a list of problems in order of difficidty? One 
investigator * studied this question by submitting the fol¬ 
lowing list of twenty-three problems to twenty teachers wlio 
were asked to estimate the per cent of pupils who would .solvl 
eacli problem correctly if given ten minutes for each. From 
this information it was possible to determine which problem 
each teacher considered easiest, which second in difficulty, 
and so on. The results of these teachers’ judgments are 
given in Table I. 

1. How much change should I expect from $5, after paying for 
B pounds of coffee at 88 cents a pound? 

2. If $1991 a day is paid to 724 men who each cam the some 
wages, how much does each man receive? 

3. A boy had 210 marbles. He lost 1/3 of tliem. How many 
were left? 

4. A grocer had a tank holding 44 3/10 gallons of oil. One day 
he drew out 15 3/4 gallons and the next day 0 1/8 gallons. How 
many gallons were left in the tank? 

5. There are 550 pupils on the roll. If 5/8 of tliem arc hero to¬ 
day, how many ore absent? 


‘ Comin, Robert, “Teachers’ Estimates of the Ability of Pupils”; in 
Sotiool and Society, vol. 3, p. 07, January 8, 1910. 
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C. K 3/4 of a pound of cheese is sold for 45 cents, how much 
can be bought for $1? 

7. A storekeeper sold 12 yards of cloth, which was 4/15 of the 
whole piece. How many yards in the whole piece? 

8. A baseball team played 160 games during the season and won 
100 of them. What port of the whole number of games did the 
team win? 

9. A store takes in the following sums: $1250.50, $300, $175, 
$16.25, $120.50, $32.75, $08.60. It pays out: $600, $300, $106.07, 
$33,33, $240. How much remains after payments arc mmle? 

10. A man bought a house for $7250. After spending $321.60 for 
repairs, he sold it for $9125. How much did ho gain? 

11. A render has 29 lines on a page and in all 10,034 lines. How 
many pages in the book? 

12. A boy lost one fourth of his kite string in a tree, one third in 
some wire, and one fifth in a hedge. What port of his string was 
left? 

13. How much will 8 3/4 dozen pencils cost at tlic rate of $1/4 
for half a dozen? 

14. If it takes a train three quarters of on hour to reach a certain 
station, what fraction of an hour will it take the train to go 3/5 of 
the distance? 

15. A man has a salary of $126 a montli. He saves 20 per cent of 
his salary. How much will he save in a year? 

10. A workman pays $22 a month for board, which is 20 per cent 
of his wages. What are his wages? 

17. Mr. Marshall receives a salary of $2500 a year. Ilis rent 
costs him 1/3 of this and his other expenses arc $1500. He saves 
the rest. What per cent of his salary does he save? 

18. John hod $1.20 Monday, Ho earned 30 cents eoclx day on 
Tuesday, Wednesday, Thursday, and Friday. Saturday morning 
he spent one third of what he had earned in the four days. Satur¬ 
day afternoon his father gave John half as much as Jolm then hod. 
How much did his father give John? 

19. A boy had $3, He paid it all for four articles, which wc will 
call A, B, C, and D. B coat os much as D. A cost as much as B, 
C, and D together. The boy sold A and B for 11 /2 times what he 
paid for them. He sold C and D for 11/4 times what ho paid for 
them. How much did he get for the four articles? 

20. A party of children went from a school to a woods to gather 
nuts. The number found was but 206, so they bought 1965 nuts 
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more from a farmer. The nuts were shared equally by the chil¬ 
dren and each received 45. How many children were there in tlio 
party? 

gl. One sTimmer a farmer hired 43 boys to work in an apple 
orchard. There were 35 trees loaded with fruit and in 57 minutes 
each boy had picked 49 apples. If in the beginning the total num¬ 
ber of apples on the trees was 19,677, how many were there still 
to be picked? 

22. A girl found that by careful counting there were 87 letters 
more on a page of her history than on a page of her reader. She 
read 31 pages in each book in the first 20 days of scluKil. How 
many more letters each day did she read in one hook than in the 
other? 

23. The children of a school made small boxes to be fillcrl with 
candy and given as presents at a school party. Six hundred boxes 
were needed. In 4 days grades 8 to 7 mode 20, 25, 83, 150, and 
150 boxes. The eight grade agreed to molce the rest. How many 
did the eighth grade make? 


Tadlh I. Showinq the Rank or PnoBioarua nv TEACHEna* 
JunOMENTS 
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Table H. Problems baitked according to Real DimcULTi 
and TEACnURB’ ESTIUATEe 


ProMm 

Rank 

(nal difflautli/) 

Avarage rank of 
itacheti' etliiruUea 

1 

3 

2 

2 

e 

4 

S 

10 

1 

4 

18 

0 

£1 

2 

6 

e 

20 

18 

7 

5 

11 

8 

4 

5 

0 

11 

: 7 

10 

0 

8 

11 

'1 

9 

12 

16.5 

13 

13 

10 

14 

14 

15 

17 

r 15 

8 

12 

16 

13 

10 

17 

14 

10 

18 

22 

20 

19 

23 

23 

20 

12 , 

15.5 

21 

10.5 

22 

22 

21 • 

21 

28 

7 

15.6 


Table I shows that four teachers judged Problem 1 to be 
the easiest, five judged it to be second in difficulty, two 
judged it to be third in difficulty and so on. The remarkable 
thing about this table is the lack of agreement in the judg¬ 
ments of the teachers. The problems are not unusual. The 
list or a portion would moke a typical examination. It 
should be clear that if a teacher giving such a list attempts 
to assign values to the several questions, the values thus 
assigned are likely to be inaccurate. It is doubtful, except in 
extreme cases such as Problem 19, whether the values will 
be more accurate than if the questions are considered to bo 
equal in value. < 

The problems were given to the pupils in the fifth, sixth, 
seventh, and eighth grades in one s^ool. The total number 
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of pupils was about 1500. By doing this it was possible to 
determine what problem actually was easiest, and the order 
of difficulty for the entire list. The average rank of each 
problem as determined by the pupils’ scores, and the rank 
IS determined by the average of teachers’ opinions, arc given 
in Table II. This table presents some interesting facts. 
Twelve of the twenty teachers agreed that Probleni 3 was 
easiest and no one ranked it above .seventh in difficulty. Its 
reel ranlc was found to be tcntli. Similar discrepancies can be 
pointed out for otlier problems, although in the cn.se of certain 
problems the average of the teachers’ estimates approximntc.s 
tlie real rank. Thus even the average judgment of twenty 
teachers on the relative difficulty of problems is not reliable 
and the judgment of a single teacher is much Ic.s’s reliable, 
(S) Rate of doing work neglected. In the second jdacc, it is 
customary in giving an examination to allow sufficient time 
for all pupils to answer all of the questions, or if this is not 
done, the papers are graded on the basi.s of what each pupil 
has done. This manner of giving an examination fails to 
take into account the rate at which a pupil is able ho answer 
the questions. Only the quality of the answers i.s con.sidcred, 
and the pupil who answers the questions with difficulty, and 
who barely finishes in the time allowed, receives exactly the 
same “grade” as the more capable pupil who i.s able to 
answer the questions easily and who finishes in one half or 
one third of Lire time, providing the two sots of answers oro 
ecjuivalent. It is clear tliat when thi.s is done, the “grade” 
or mark which the pupil receives is not a true measure of his 
ability, because tlic rate at which he is able to do work is 
a “dimension” of his ability as well as the quality of what 
he does. In certain cases the rate may be a relatively un¬ 
important dimension. Neglecting it in measuring the ability 
of a pupil is much like neglecting the width in measuring a 
rectangle to determine its area. 



16 MEASimiNG THE RESULTS OP TEACHING ' 

Some may insist that it is unfair to the aloW'working pupil 
not to allow sufficient time for him to answer all of the ques¬ 
tions. However this may be, it certainly is unjust to the 
more capable pupil to deprive him of the opportunity to 
demonstrate what he is able to do. This is exactly the case 
when the work asked of him is sufficient to keep him em¬ 
ployed only a half or a third of the period allowed for the 
examination. This practice of ignoring the rate of working 
probably tends to cause desultory and careless school work. 

Investigation has shown, that rapid work and a high de¬ 
gree of quality or accuracy are not incompatible in arith¬ 
metic. The same statement can be made with reference to 
reading. Investigation has indicated that a considerable per 
cent of pupils can be made more accurate in arithmetic by 
forcing them to work more rapidly. It has also been shown 
that about three pupils out of four make progress in rale of 
work and accuracy at the same time. In view of these facts, 
it appears that good instruction requires that tlie teacher 
give attention to the rate of doing work as well as to the qual¬ 
ity of the work done. The rate at which a pupil is able to do 
work of a given quality is as much a factor of his ability as 
is the quality of the work which he does. 

The rate at which a pupil works can be measured very 
easily. It is simply necessary to secure a record of the time 
which he spends in answering the set of que,stion 3 . When an 
examination is given to a group, it is rather inconvenient 
to secure a record of the time which each pupil spends upon 
the examination. However, one can secure just as true a 
record of the rate at which each pupil works hy making the 
examination long enough so that no pupil finishes in the 
time allowed. For each pupil the number of minute.?, di¬ 
vided hy the number of units of work which he did, will give 
his rate of working per unit. 

Summary. In the preceding pages we have shown, first, 
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that questions differ in difficulty and that teachers cannot 
judge their relative difficulty with reliability; and, second, 
that the rate of doing work, which is in many cases an im¬ 
portant “dimension” of ability, is commonly neglected in 
giving examinations. The first of these conditions con¬ 
tributes to the inaccuracy of marking examination pafrera. 
The second means that the examination iiaix:r frequently is 
not a true record of the pupil’.s ability. Thi.s hapiHius when 
the pupil finishes before the end of the period allowed. TJierc 
are two other points which should Im mentioned in this con¬ 
nection. Marks jjlaced upon examination pajairs do not 
have a definite meaning becau.se a wide range of topics is 
included within a single examination and bccaase no reli¬ 
able standards exist. 

Wide range of topics included within an examination 
makes the “grade” have an indefinite meaning. Examina¬ 
tions are usually made up of questions from a numl>er of 
different fields within a subject. Take, for example, the 
following examination in arithmetic whicli was given to a 
sixth-grade class: 

1. Write in Roman system: 40, 70, 04, 00,140. 

2. If 11 A. of land are worth $1485. wlmt is one aero worth? 

3. It a desk is 4 2/3 ft. long and 3 6/12 ft. wide, what is tlw 
perimeter? 

4. How much must you add to 20 7/8 in. U) make a yard? 

5. A man has to travel 117 mi. After going 5/0 of the (liaUnde, 
how many miles lias he .still to travel? 

6. The perimeter of a square is 851 In. What is the length of 
one side? 

7. Of 152 chickens a hawk captured 12 1/2%. How many were 
captured? How many were left? 

8. A man saves $075.20 a yr., which is 32% of his income. UoW 
much is his income? 

9. At $1..38 a yd., what will 37 yd.s. of eariJet co.st? 

10. At $05.60 an acre, what must a man pay for 25.4 acres of 
land? 
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' Question 1 calls for a knowledge of Roman numerals; 
Question 2 asks the pupil to find the cost of a unit when the 
cost of the whole is given; Questions 3, 4, and 6 deal with 
mensuration; Question 5 calls for the finding of a fractional 
part of the whole; Questions 7 and 8 are problems in buying. 
Thus we find six different topics included within an exam¬ 
ination of ten questions. 

Suppose a pupil receives a “grade” of 80 on this exami¬ 
nation. Even if 80 is an accurate measure of what the 
pupil is able to do on this examination, it cannot have a 
definite meaning. It does not tell us whether the pupil 
lacks ability in the field of Roman numerals, or in tlie field 
of percentage, or in some other of the fields included in 
this examination. In order that the total score made on 
an examination may be a definite measure of a pupil’s 
ability, the questions which compose it must be drawn from 
a single field, or at most from a small group of closely related 
fields. If this is not done, the scores for each question must 
be kept separate in order to have a definite meaning. 

The situation is much the same ns if the length, width, 
height, seating capacity, number of windows, and the num¬ 
ber of doors of a room were added together to form a measure 
of the room. If we assume that each of these characteristics 
of the room was measured with a high degree of accuracy, 
the total of the numbers expressing the measures gives us 
only very general information about the room. If lie total 
is large, we know that the room is probably large; if the total 
is small, we know that it is small. But under no circum¬ 
stances can we be certain that the room has any windows 
or doors, that it contains any seats, or that its dimensions 
are well proportioned. In order that we may have definite 
information about the room, it is necessary that the meas¬ 
ures of the several characteristics be kept separate. 

No standards for interpreting measures. The fact that 
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a seventh-grade pupil solves correctly eight problems out 
of seventeen or spells correctly twenty-one words out of 
twenty-Cve has a meaning only by comparison with the 
standard for these examinations. By standard we mean 
the number of problems which a pupil of a given grade, in 
this case the seventh, should do correctly when given this 
examination. If the standard is twelve problems, tliis pupil 
is below sevcntli-grade standard in ability and has not done 
satisfactory work. On the other hand, if the staiuhird ts six 
problems, this pupil is above standard and i)os.se.sse8 suixirior 
ability. Without a standard a teacher cannot know what a 
measure means. 

The above statement may not appear to be true at first 
thought. Standards have not been detennined for the exam¬ 
inations which a teacher gives, but he “gue.s3e,s” what the 
standard should be when the questions are made out and 
the examination is judged by the teacher to Ixj “fair” for 
the pupils of that grade or one “ they should able to 
pass.” We have just seen how unreliable tcjxchcrs’ judgments 
are with reference to the difficulty of problems in aritlune- 
tic. Their “guesses” with reference to standards apijcar to 
possess about the same degree of reliability. 

Accurate measurements of the abilities of pupUs may be 
made by using standardized tests. TJic i>rccx'dirig pngea 
were written to make clear that om present measurements 
of the abilities of pupils were inaccurate and hence unsat¬ 
isfactory. Since the measurement of results is very neces¬ 
sary to both the teacher and the supervisor, there is a need 
for instruments with which accurate mea.sutemcnt.s cfui Ik; 
made. Standardized tests are such instruments and in the 
following chapters certain ones will he described and direc¬ 
tions given for their most effective use by the teacher. 

Standardized tests have been .scienLificui.lly devi.scd. The 
questions or exercises which make ui> the tests have been 
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carefully selected and evaluated. Directions have been 
provided so that different teachers will assign the same mark 
to the same paper. The rate of work is measured where it is 
an important '“dimension” and the tests have been stand¬ 
ardized. Generally a standardized test is limited to a .single 
topic or to a small group of topics so that a pupil’s score has 
a definite meaning. These features eliminate tlie defects in 
ordinary examinations which have been discussed in tliis 
chapter and hence constitute reasons for tlie use of stand¬ 
ardized tests. 

Other advantages in using standardized tests. Standard¬ 
ized tests are helpful in another way to the teacher, paidic- 
ularly the rural teacher who must work isolated for tlie most 
part from other teachers. The standards of sucli tests are 
definite objective aims stated in a way that both teacher 
and pupil can understand. The value of a definite standard 
can hardly be overestimated. As we shall show later it fur¬ 
nishes a strong motive. It also guides one’s efforts. It makes 
possible economy of time by limiting training. The u.sc of 
standardized tests directs attention to the results which me 
to be attained. Too often attention has been focused upon 
the method being used rather than upon the results, A third 
advantage is due to the fact that the patrons of tlie school 
are interested in definite statements of results, particularly 
when those results can be compared with recognized stand¬ 
ards. Many objections to a teacher or a scliool have been 
answered by the accurate measurement of results. The 
writer has heard one superintendent state that standardized 
tests would be worth using if they did nothing more tlian 
stop the mouths of those who are accustomed to complain 
about what the public school is doing. 
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QUESTIONS AND TOPICS FOR STUDY 

1. IVhat evidence do ive have for showing that "liiial grades" arc iunc* 
curate measures of the abilities of pupils? 

2. How do we luiow that the marking of examination papers is in^ 
accurate? 

3. What factors contribute to tliis inaccuracy? Can you think of any 
not mentioned in this chapter? 

4. Have you ever felt tluit examination marks were inaccurate? Why? 

5. Ask several teachers to "grade" the same ect of papers and compare 
the "grades" given to each paper? 

0. Whttt is meant by saying that a "pdo" has nn indefinite meaning? 

1, Wliat is a standard? Why are standards needed? 

8. What arc the advantages of using standardized teats? 

6. The unreliability of individwil judgment may k shown hy having a 
group of persons guess the length of a stick when it is held os much 
as ten feet away from them, 

10. What is meant by saying that die rate of doing work is a "diinen* 
siou" of a pupil’s ability? Why is it important to measure it? 



CHAPTER fl 

THE MEASUREMENT OP ABILITY IN READING > 

Thebe are two types of reading, silent reading and oral 
reading. In reading silently one is concerned primarily 
■with understanding the printed page. In oral reading the 
point of emphasis is the coramunicaLion of the meaning by 
means of oral expression. Both kinds of reading are taught 
in the school, and the first step in the measurement of ability 
in reading is to recognize the existence of the two types of 
reading ability. We shall consider their measurement in 
t'wo separate sections. 

I. Silent Reading 

1. Mmfoe's Standardized Silent Reading Tests 

Ability to read silently is measured by having the pupil 
read a selection and then give evidence of the degree of his 
understanding or comprehension of the material read. One 
method of securing this evidence is to require the pupil to 
answer one or more questions based upon what he has read. 
This plan may be illustrated by the following paragrai)h 
and question. Answering the question requires that the 
pupil comprehend the principal idea of the exercise. 

Not far from Greensburg is a little valley, among tlie high hills. 
A small brook glides through it, with just murmur enough to lull 
one to repose; and the occasional whistle of a quail, or tapping of 
a woodpecker, is almost the only sound that over breaks in upon 
the uniform tranquillity. 

> The reader should have a copy of each of the standardized te.sLs de¬ 
scribed in this and the following chapters. In several instances it will 
he almost impossible to understand the discussion without a copy of the 
test at hand. See the Appendix for directions for securing a sample package 
and for purchasing any of these tests for class use. 
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What kind of a picture do you get from reading the above 
paragraph? 

disorder activity noise calmness confusion 

This exercise is expressed in such a way that the pupil will 
have no difficulty in expressing his answer if he knows wdiat 
it is, and also his answer will be cither right or wrong. There 
can be no difference of opinion in marking the exerei.so. 
A series of tests, known as Monroe’s Standardized Silent 
Reading Tests, consists of a number of such excrei-scs. The 
exercises were taken from school renders and other books 
tliat cliildren read which insures that they pre.sent tyi)ica} 
reading situations. The amount of credit to be given a pupil 
for doing each exorcise correctly has been seienlifioally de¬ 
termined and is called the comjrrclicnsion value. Tlie sura of 
the comprehension values of the exercises done correctly in 
five minutes makes the pupil’s compreltensim score. This 
score is the measure of his ability to comprehend or under¬ 
stand the exercises of tlic Lest. 

The pupil’s rate of reading is important as well ns the de¬ 
gree of his understanding, l^or this reiuson each cxerci.se Inis 
a rate value, and a pupil’s rate score is the sum of the rate 
values of the exercises which he tries in five minute.s regard¬ 
less of whetlior he does them correctly or not. Thi.s value 
has been so chosen that it represents the number of words 
which tlie pupil reads per minute. A pupil’s rale score is the 
measure of his rate of reading. 

Test I of the scries is for Grades III, IV, and V, Tost II 
for Grades VI, VII, and VIII, and Test III for Griulos IX 
to XII. There are three forms of Te.sts I and II which are 
equivalent in difficulty, so that when it is desired to measure 
the ability of the pujiils a second or tliird time it i.s not 
necessary to use the same exercises. A few excrei.se.s oi 
Test II are reproduced to illustrate more fully this tyjxi 
of silent reading test. 
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Rate 

Value 

7 


Rate 

Value 

a 


Rate 

Value 

II 


Rate 

Value 

17 


No. 2 

At evening when I go to bed 
I see the stars shine ovcrhencl; 

They are the little daisies white 
That dot the meadow ot the night. 

What are the little white daisies of the night? 


No. 4 

They rested and talked. Their talk was all 
about their flocks, a dull tlicme to the world, 
yet a theme which was all the world Lo them. 

What do you suppose was tho occupation of 
these men? 

carpenter doctor merchant 

shepherd blacksmith 


No. 7 

He was a wicked ruler who, with his still 
more wicked sons, oppressed and wronged the 
people in many ways. 

If the people would be sorry when tho ruler 
and his sons died, draw a lino under the word 
ruler; if they would be glad, cross out the word 
ruler. 

ruler 


No. 10 

It was cold, bleak, biting weather; foggy 
withal; and he could heor the people in tho 
court outside go wheezing up and down, beat- 
mg their hands upon their breasts and atamp’ 
ing their feet upon the pavement-stouca to 
warm them. 

The author has attempted to give you a 
picture in this paragraph. After reading the 
paragraph, if you think it is a picture of com¬ 
fort and pleasantness, draw a line under the 
word hear; If ot cheerlessness and dreariness, 
draw a line under bleak. 

hear wind bleak cold 


Compre¬ 

hension 

Value 

2.1 


Compre¬ 

hension 

Value 

3.7 


Compre¬ 

hension 

Value 

2.0 


Compre¬ 

hension 

Value 

4.3 
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Directions for using the tests. Detailed directions for 
giving these tests are printed on the first page of the test 
paper and hence it is not necessary to reproduce them here. 
However, there arc fom" general rules which should he fol¬ 
lowed in the giving of all standardized tests: (1) Follow the 
printed directions carefully. Do no more or no less than the 
directions specify. Do not try to imi)rove upon the direc¬ 
tions. Comparisons of the scores of your pupils with the 
scores of other classes and with the standard scores will not 
be valid if the printed directions are not followed, becaii.se 
these scores were obtained according to these conditions. 
(2) Be careful to allow exactly the number of minutes speci¬ 
fied — five minutes. Use a watch with a second-hand or a 
stop-watch if one is available. (3) The examiner should ex¬ 
ercise care not to excite or frighten the pupils by his manner 
of giving the tests. He should not be in a hurry. lie .should 
not be cross. lie should remember that reliable mca.surc- 
ments of the abilities of the pupils will not be obtained unle.s.s 
the pupils work naturally. (4) Study the directions for the 
testa until you are familiar with them. It is wi.se to go 
through the directions at least once imagining that you have 
the class before you. Your failure to ])o familiar with the 
directions may affect the scores of your pupils. 

Giving the tests in rural schools. Tlicsc silent reading 
tests may be given to a group of pupils belonging to scveml 
different grades as easily os to a group belonging to a single 
grade. It is only necessary to sec that eacli pupil is ]>ro- 
vided with the test which is designed for his grade. The 
time allowance is the same for all grade.s. In a rural school 
it will be most convenient to test all of the puinls above the 
second grade at one time. In recording the .scores it will, of 
course, be necessary to record Ure scores for the different 
grades separately. 

When the testa should be given. These silent reading 
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tests are not teaching devices. They are instruments for 
measuring the ability of pupils to read silently. They should 
be given at the beginning of the school year so that the 
teadier may know his pupils better. If tliey are not used at 
the beginning of the year, they may be given at any time, 
preferably as early as convenient. The tests should be re¬ 
peated at the end of the year so that the teacher may know 
how much his pupils have increased their ability to read 
silently. When the tests are given a second time a different 
form should be used. If it is desired, the tests may be given 
a third time at the middle of the year, but they should not 
be given more than three times a year. 

Scoring the test papers. The correct answer for each ex¬ 
ercise is given on the back of the class record sheet which is 
always furnished with the tests. It is most satisfactory for 
the teacher to mark the papers, but if tlie teacher feels that 
he cannot take the time for it he may read the answers 
and have the pupils mark tlieir own papers, or better, have 
them exchange papers. In any case the teacher should ex¬ 
amine enough of the papers to make certain that they have 
been marked correctly. The question has been asked, 
“Should the pupils be requu’ed to give their answers in the 
form of complete sentences?” This is not required. The 
author does not believe that it is wise to insist upon t.hi.g 
form. 

Good arrangement of scores. The significance of a group 
of facts, such as tlie scores made by a class upon a test, may 
be made more evident by certain methods of arranging 
them. Take, for example, the comprehension scores which 
were made by a sixth-grade class of thirty-five pupils when 
given a certain silent reading test. Wlien these scores are 
presented in the manner of Table III, the array tends to 
confuse. One must scan the entire array to learn tlaat the 
lowest score is 4.2, or that the highest score is 30.1. One 
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cannot easily leam that pupil BB, who made a score of 14.9, 
stands eighth from the poorest in the group. If now the 
scores are simply rearranged in order of magnitude, as .shown 
in Table IV, their significance is much more easily gra.sjK'd. 


Table III. Suowinq a Poor AuiiANaUMENT or Scokes 


Pupil 

Scare 

JPupU 

San-e 

PupU 

Scare 

A 

87.3 

M 

10.0 

Y 

10,0 

B 

10.2 

N 

10.3 

Z 

10.1 

C 

8G.2 

() 

21.1 

AA 

15.4 

D 

22.5 

P 

2.5.0 

BB 

14.0 

£ 

15.4 

Q 

21.1 

vx: 

10.4 

F 

18.3 

R 

15.0 

in) 

14.1 

G 

28.4 

S 

10.1 

KE 

4.2 

H 

17.4 

T 

6,0 

FF 

20.0 

I 

25.1 

u 

80.1 

(!« 

21.1 

J 

15.7 

V 

22.3 

nil 

20.3 

K 

11.8 

w 

1.3.1 

11 

25.8 

L 

21,0 

X 

12.8 



Table IV. Showing the Same Sooiies nEAKRANani) in a 


llKTTEa Okdeu 



PiipU 

Scare 

Pupil 

Scare 

Pupil 

Score 

EE 

4.2 

Y 

10.0 

V 

22.3 

T 

5.0 

s 

10.1 

I) 

22.6 

M 

10.0 

N 

10.3 

GG 

2t,l 

K 

11.8 

cc 

10.4 

I 

25.1 

X 

12.8 

II 

17.4 

P 

25.0 

W 

1.3.1 

F 

18.3 

11 

25.B 

DD 

14.1 

7j 

10,1 

C 

20.2 

BB 

14,0 

B 

10.2 

iin 

20.3 

AA 

16.4 

PP 

20.0 

A 

27.8 

E 

15.4 

0 

21.1 

G 

28.4 

J 

15.7 

Q 

21.1 

u 

80,1 

R 

15.0 

L 

21.0 



Recording the scores. 

For securing a good arrangement of 

the scores obtained by using Monroe’s 

KtandardiKcd Hilent 


Reading Tests the class record sheet shown on page 28 is 
used. It will be noted that the scores ore arranged in order 
of magnitude by groups. This kind of an orrangeinont of 
scores is called a distribidion. For comprehension, all of 
tlie scores from 3.0 to 8.0 ore grouped togetJicr. The dif- 
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S8 


Jtate Score 


Gompreltenfllon Score 


Iiit«rTiil 


of 

Fuplla 


IntoTTal 


Number 

of 

Fuplls 


Aliovs 100 
Ul to 160 
Ml to 160 
131 to 140 
121 to 130 
IIG to 120 
111 to 116 
103 to no 
101 to 105 
03 to lOO 
01 to 06 
83 to 00 
B1 to 86 
73 to 80 
71 to 76 
63 to 70 
01 to 06 
63 to 00 
61 to 66 

10 to 60 

11 to 46 
83 to 40 
81 to 36 


80 & above 
70 to 70.0 
SO to 00,0 

50 to 60,0 
46 to 40.0 
40 to 44.9 
36 to 30.9 
30 to 34.0 
27 to 20.0 
24 to 26.0 
21 to 23,9 
18 to 20,0 
18 to 17.9 
13 to 14.0 
11 to 12.0 
0 to 10.9 
7 to 8.0 
6 to 0.0 
4 to 4.0 


28 to SO. S 

21 to 26. 2 

16 to 20. 1 

Below 16 .. 0 

Total 

Medlou 


to 8.9 
to 2,0 
to to 
to .0 
Total 
Median 


Fig. 4. Snowma Form MflED in becordxnq 

THE SconOB OBTAINED BV USING MoNBOE's 

Standardized Silent Reading Tests. 


ference between 3.0 
and3.9 (moreexact¬ 
ly 8.9999-) or 1. 
is called the loidik 
of the interval. On 
this record sheet all 
of tlie intervals do 
not have the same 
width. For exam¬ 
ple, the interval 
from 24.0 to 20.9 
has a width of 3. 
Detailed directions 
for recording the 
scores are printed 
on tile class record 
sheet and need not 
be repeated here. 

The central tend¬ 
ency of a distribu¬ 
tion. Ordinarily the 
scores of a class will 
be distributed over 
several intervals of 
the class record 
sheet. If one wishes 
to compare the 
standingof theclass 
as a whole with the 
standard, it is ne¬ 
cessary to obtain a 
central tendency of 
the distribution. The 
central tendency 
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which is best known by teachers is the average, but if 
one or two pupils make very low scores they will bring the 
average down. For this reason the median is tised in¬ 
stead of the average. The median is the value of the middle 
score of the distribution. The median score for comprehen¬ 
sion is found by arranging the test papers according to the 
size of the comprehension scores. When the test papers are 
arranged in order, the score on the middle paper is the me¬ 
dian score. For exaini)le, if tlicre are thirty-five i)aperH in 
tlie pile, the score on the cightccntli i)aper in the median 
score. If there are tliirty-six papers, tlie median score is 
halfway between the score on the eighteenth paper and the 
score on the nineteenth paper. The median score for rate is 
found the same way. The median scores arc called the class 
scores. 

Summary. We have dc.scribcd Monroe’s Standardized 
Silent Reading Tests, the directions for giving them, for re¬ 
cording the scores and for finding the class scores. In the 
next chapter we shall take up the meaning or interpretation 
of the scores and Avhat a teacher should do to correct tho 
conditions which the tests reveal. 

Conriis’s Silent Reading Test No, ® 

Description of the test. This test, which is to be mted in 
Grades 2 to 0 inclusive, is designed to men.sui’e "the ability 
to read silently and understand a ,simi>lo story and .simple 
questions about the story.” It consist.s of a cormected story 
of the kind that children enjoy rending. The first two para¬ 
graphs of Part I of the test are reproduced on page SO to 
show tlie type of story and its arrangement. 

The pupils are directed: “Read silently^ and only as fast 
as you can get the meaning; for when you have finished you 
will be asked to an.swer questions about what you have read. 
You vriU be marked for both, how much you read and how 
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well you understand it, but it is better to get the meaning 
of the story than to read too fast.” 

The pupil reads silently for three minutes, but nt the end 
of each half-minute a signal is given, and he is to mark the 
last word he has just read and to keep on reading. At the end 
of three minutes the pui)il turns to Part II. This eonsist.s of 
the same story with questions based upon it. The first two 
paragraplis and tlie questions upon them arc rci)roduced. 

When the aprinK sun was warm and the Hi)rinK flower.a hod begun 
to bloom, our children luul a May-party out on the lawn. Every 
little boy or girl who lived nearby was invited. Betty wrote Uie 
invitations and Bobby carried tlicm to tlie children. 

A. Did the children have a May-party? ..... 

B. Was it Bobby who wrote the invitations? .... 

C. Was the party held in the liouse? ... 

D. Were only girls invited to the party? .. 

E. Had the spring flowers begun to bloom? .. 

When tho day of the parly came, Daddy planted a May-pole 
and Mother tied it with gay-colorc*d ribbons. There were hj Iw 
games and dances on the gro-ss and a delicious supiKir, with a 
basket full of flowers for every child. 

1. Were the children to have anything to cat? .. 

2. Wore tliey going to play on Hu; gross?.. 

8. Were tlicy going into the house to <lance?.... 

4. Were tho btuskels to be full of flowers? .. 

6. Was it Daddy who ticKl the ribbons to the polo? _____ 

The measures of the pupil's abUity to read silently and 
answer questions. Tlic pupils are given five minutes to an¬ 
swer as many of the questions os they can, The raetisure of 
their understanding of the story is expressed in terms of the 
number of questions answered and tho index of comprehen¬ 
sion. This index is found as follows: “Subtract the wrong 
answers from the right answers. (If there are more wrong 
than right, find the difference and give it a negative sign.) 
Divide the difference by Uie number of right answers, 
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carrying the result to three places and keeping two.” This 
calculation is made from a table so that the labor involved is 
reduced to a minimum. 

In addition to these two scores, the number of words read 
per minute is obtained from the first part of the test. This 
is a measure of the pupil’s rate of reading. 

Directions for using Courtis's Silent Reading Test No. 2 . 
Detailed directions for giving the test have been prepared 
by the author of the test. These do not need to be rcijcated 
here, but tlie general directions mentioned on page 25 ai)ply 
to these tests as well. Courtis says: 

The instructions given in this folder must be followed exactly 
if the results secured are to be compared with results from the 
same testa in other schools. The examiner needs to prepare him¬ 
self for his work by careful study and practice. 

The important conditions to be controlled are timing, instrnc- 
turn, and manner. Keep exext times. Say no more to the children 
about the tests than is provided for in tlie instructions below. 
Give the instructions energetically, but easily and pleasantly. Do 
not hurry, do not get excited, do not be cross with the children. 
The children will make the best scores if they enjoy the tests and 
work naturally. 

Directions for using Courtis's Silent Reading Test No. 2 
in rural schools. Since the same test is given to all i^upils in 
Grades 2 to 6, the procedure for giving the test is always the 
same and therefore it may be used as easily in rural schools 
as in graded schools. The only difference comes in recording 
the scores. Then the teacher must first be careful to liave 
the test papers grouped correctly by classes or grades. 

Scoring tiie test papers. An answer card and detailed di¬ 
rections axe furnished with the tests. The most accurate 
results are obtained when tire test papers are scored b.y the 
teacher, but Courtis says: “A teacher might better give her 
time to studying the results than waste it on scoring.” His 
plan is to have the scoring done by the pupils in the fifth 
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and sixth grades and by the seventh- and eighth-grade 
pupils in the case of pupils below the fifth grade. The sc:orc>.s 
of a pupil are recorded on an individual record card which is 
more convenient to handle in recording the scores of the 
class on the class record sheet. 

Recording the scores. The three score.s, rate of reading 
(words per minute), number of quesUon.s, and the index of 
comprehension are recorded on tlieforms Timrked Tiil)le 1 and 
Table 3 in Fig. 5. The form of Table 1 is .similar to that msed 
for recording the scores of Monroe’.s Stundarilized Silent 
Reading Tests. However, it should be remembered that in 
Table 1, 0 means 0 to 19, 20 means 20 to 30, and so on. 
Table 3 represents a different ty]>e of form for rcciording 
scores. The test papers, or in this case the individual cards 
containing the record of the pupils’ scores, are first .sorted 
into piles according to the number of questions answered, 
putting into the first pile all the cards liaving a .S(;ore of 0 
to 4 questions answered, into tlie .second pile all tho.se cards 
having a score of 5 to 0 qnestion.s answered, ami similarly 
for the other intervals. Then each of these idles is sorted 
according to the “index of comprchen.sion.’’ Sui)i>o.sc there 
are seven cards in the pile of forty-five to forty-nine ques¬ 
tions answered and that these have the following “iiuliTOS of 
comprehension”: —16, 20,47, 68, 78, 70, 80. The entries for 
tliese scores would be made on the “45 line.” To record the 
-15 score, a 1 is placed in the “l/css than -5” column; to 
record the 20 score a 1 is placed in the “0-89” column; to 
record the 47 and 68 scores a 2 is placed in the “40-00” 
column; and so on. 

Distributions and central tendencies. The column and 
line marked “Total” in Tabic 3 are filled in by fintiing the 
simr of the .scores recorded in the ro.speelive lines or columns. 
These tw'o sets of sums form the distributions for " nximber 
of questions answered” and “inde.x of couipreheuaion,” 
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The numbers in the column headed "Number of children 
making each score” in “Table 1” form the distribution for 
the rate of reading. The central tendency of the distribution 
which is used to describe the achievement of the c’las.s as a 
whole is the median the same as was used for JMonrot'.’.s 
Standardized Silent Reading Tests. It may be found in the 
same way, although the directions given by Courtis ditfer 
slightly. 

Summary. In the preceding pages wc have dc.seribed 
Courtis’s Silent Reading Test No. 2 and the general di¬ 
rections for giving it and for handling the scores. De¬ 
tailed directions arc given in the folders, B and D, which 
should be secured when the tc.st is purchased for classroom 
use. 

Comparison of the two silent reading tests. In comparing 
the two silent reading teals which we have just described, it 
musTt be remembered that they probably do not measure 
the same typo, of silent rcafling al)ilily. We cannot, there¬ 
fore, compare them as wc might two things of the .same kind, 
as we might two makes of the same tyi>e of automobile. 
The situation is much like comparing a pleasure car wth a 
truck. However, certain points may Ikj noted. Courtis’s 
test is to be used in Grades 2 to 0, while Monroe’s tests are 
to be used in Grades 3 to 8. Thus a second-grade teacher 
would choose Courtis’s test. Some claim that it is rnon; sat¬ 
isfactory for the third and fourth grades, but that INIonroe’fl 
lest should Ire used Ircginning with the sixth gnule. Of the 
two tests, Monroe’s takes lcs.s time and is mmplcr to under¬ 
stand and use. For the teacher who is inexperienced in the 
use of standardized tests this is an imjKrrlant consi<leration. 
However, it is frequently profitable to give both tests. One 
will supplement the other. 
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3, Thorndike's Visual Vocabulary Scale 

Need for a vocabulary test. When a pupil makes a silent 
reading score which is below standard, it may be due to any 
one of several causes or to a combination of causes. One 
important cause and one which frequently occurs is the 
pupil’s failure to comprehend the meaning of the words. 
Understanding the meaning of a paragraph requires the 
ability to comprehend the meaning of tire individual words. 
Hence a vocabulary test furnishes a means for obtaining 
information which may reveal the cause of the pupil’s low 
score in silent reading. 

Description of the test. This test can be most satisfac¬ 
torily described by reproducing a portion of it. Each pupil 
is given a test paper on which are printed the following 
directions and lists of words. 

Thokndikb Rbadinq Scale B, Word Knowledoe or Visuaii 
VocABunARY —Series X 

Write the letter W under every word that means somctliing about 
war or fighting. 

Write the letter B under every word tliat means sometliing about 
business or money. 

Write the letters CHU under every word that means somctliing 
about church or religion. 

Write the letter R under every word like father or wife that means 
something about relatives or the family. 

Write the letters COL under every word that moans a color. 

Write the letter T under every word like now or then tliat means 
something to do with time. 

Write the letter D under every word like here or north that means 
somethmg about ^stance or directioa or location. 

Write the letter N under every word like ten or much that means 
something about number or quantity. 

4.0 camp, flag, west, motlior, two, general, green 

troops, south, fort 
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i.S 

gray, cousin, pink, uncle, yellow. 

hour. 

pay. 


aunt, early, commander 



5.0 

marriage, defeat, many, oftomixm. 

guard. 

buy, 


captive, military, relation, late 



6.0 

hymn, defend, otiross, merchant. 

nix)n, 

forty, 


conquer, dagg<ir, profit, Tuesday 




There are eitflit other lists wliieh gradually increase in 
difEculLy. TJie scale values of the several lines printed in tlie 
left margin were determined by having several thomand 
cliildren undertake to indicate the meaning of each word. 
The greater the i)er cent of children who c'onld not i)i(li('ale 
correctly the meaning of the word, the higher the value at¬ 
tached to the word. The pupil’s score is the value of the 
most difficult li.st in which he inarks correctly eight out of 
the ten words. Likewise the clu.s.s acort; is the value of the 
list for which the class averages 80 i)er cent (8 out of 10) of 
correct meanings. 

Giving the test. Detailed directions for giving this kst are 
printed on the cover of tlie test.* It i.H, tlierefore, necessary 
only to remind the reader that the general directions t)n 
pages 25 and 32, with reference to following directions and 
the manner of presenting the tests to the pupils, apply, 

Recording the scores. Thc! class record sheet devised by 
Thorndike called for a detailed record for each pupil. This 
was cumbersome to use and reciuired more labor than ap- 

* Tliis is not true of form of the lest whieh is seeured from the 
Bureau of Publications of Teaclicra College, but is true of the fopiji dis¬ 
tributed by the Bureau of Educational McoaiircmcnU and Standardav 
Emporia, Kansas. ,' 
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peared to be justified for obtaining the class score. A simpler 
class record sheet has been designed by the writer. This is 
reproduced in. Fig. 6. Directions for recording the .sc!orc.s un 



Clasa Score... 

Fiq. 0. Heoohd Shbbt fob nBooaMNQ Scoiwa odtaindd by ubinq 
THOBNDiKEi’a ViBTJAB VocABDLAHT Scam, 
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this sheet and for calculating the class score are printed on 
the back of it and thus need not be reproduced here. The 
calculation of the class score may appear to be difllcult to 
understand, but if the directions are studied carefully and 
followed a step at a time, one should soon learn how to do it. 

II. Oiuii Readinq 
1. Qray's Oral Reading Test 

Description of the test. For measuring tlic ability of 
pupils to read orally. Gray has devi.sed a test cjou-sisling of 
a aeries of paragraph.s arranged in order of gradually in., 
creasing difficulty in oral reading. The test is designed to 
be used in all grades beginning with the first. The nature 
of the test can best be illustrated by reproducing a few of 
tlie paragraphs! 

I. A boy had a dog. 

The dog ran into the wcmkIs. 

The boy ran after the dog. 

He wuntc'tl tlio dog to go home. 

But the ilog would not go home. 

The little boy said, ‘T cannot go home wiUumt my dog," 

Then the hoy begun to cry. 

C. It was one of those wonderful evenings such an are found only 
in tliis uiagnifieetit region, The sun liud sunk beliiiid the momi- 
tains, but it was still light. The pretty twiligld glow (fmbraeed a 
third of the sky, and against its brilliancy stood tlio dull white 
masses of the mountains in evident contrast. 

II, The hyprjtlicsoH concerning physical phenomena formulaUsl 
by the efirly pliilosophera provcsl to Iht hu^fiiiaislent utul hi 

not miiversally applicable. Before relatively uccuraUi prhicijdea 
could be establi-shed, physicists, mathematicians, and statisticians 
had to combine forces and work arduously, 

Givmg the test. In giving the test the pupils are taken one 
at a time and asked to read beginning with the first jrara- 
graph. As the pupil reada, the teacher records on auoihra; 
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copy of the test, two sets of facts: the mimber of seconds 
the pupil takes to read each paragraph and the errors which 
are made. To obtain tlie number of seconds the teacher 
must have a watch with a second-hand or, better, a stop¬ 
watch- Six types of errors are recorded; (1) complete mis¬ 
pronunciation of a word so as to indicate tliat the pui)il has 
no control over it; (2) partial mispronunciation; (3) omis¬ 
sions; (4) substitutions; (5) insertions; and (0) repetitions. 
The metlrod of marking these errors on the test i)aper is 
illustrated in the following quotation from the class record 
sheet: 


Thfl aun pie/ced into*m^large windows, It was the opening 
of October, and th^aky was^a dazzling blue. I looked out of 
my window^^own the street. The white hou8c|y>f the long, 
a@alght street wore (^ost painful to the eyes. The clear 
atmosphere allowed full play tg ^ujl^rightneas. 


If a word is wholly mispronounced, underline it as In tlie case of 
“atmosphere." If a portion of a word is mispronounced, murk ap¬ 
propriately as indicated above: “pierced" pronounced in two syl- 
lables, sounding long a in “dazzling," omitting the a in "houses” 
or the al from "almost,” or ther in “straight.” Omitted words are 
marked as in the case of "of" and “and"; substitutiona os in the 
case of "many" for "my”; insertions os in tlie cose of “clear" 
and repetition as in the case of “to tire sun’s.” Two or more 
words should be repeated to count as a repetition. 

To give the teat satisfactorily requires practice in detect- 
mg the errors and in recording them. The teacher should 
have some one read the test, intentionally making errors, 
so that he may become skillful in giving it. 

The pupil s score. The pupil’s score depends upon both 
the number of seconds he takes to read the different para- 
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graphs and the number of errors which he makes. For ex¬ 
ample, certain credit is given a .second-grade child for read¬ 
ing paragraph 1 in forty sceond.s with le.s.s than five error.s, 
and additional credit i.s given the .same child for reading the 
same paragraph In tldrty .seconds with le.ss than five error.s, 
or in forty seconds with lc.s3 than four errors. Still different 
credit is given to third-grade chikinm for each of the nlH)ve 
achievements with paragraidi 1. 'VVlien the combination of 
length of time and numljcr of errors exeeed.s a certain pre¬ 
scribed maximum, no credit is allowed. The score of any 
child is ascertained l)y a<Iding together all the credits which 
he has earned on the .several paragrai)hH. This pro(;e.s.s be¬ 
comes much more .simi>lc than it souinl.s lierc when explicit 
directions and the detailed data for each child and for tabu¬ 
lating results are at hand. 

Silent reading versus oral reading. Notwilh,standing the 
fact tliat oral reading has received much greater cmjthasi.s in 
our schools tlian silent reading, the hitter is far more imimr- 
tanl. Silent reading i.s required in [iractically all of the other 
school subjects. Al.so the pujiil will rea<l silently much more 
frequently than orally after he leave.s .school. However, at 
first oral reading is a moans for teacliing silent reading. 
Hence in the primary grado.s it is w'orth while to measure 
tlie ability of pujiils to read orally. 

Summary. In tlii.s cduipler we liavc described two .silent 
reading tcsls, one voisibulary test and one te.st for oral read¬ 
ing. The detailed instructions for msing tlie.se le.sts have not 
been reproduced since they always lue furai.slietl willi the 
tests. We have given only lho.sci giuieral direelions which 
were considered necc.s.snry for understanding the. Ic.sl.s and 
the scores obtained by using them, (lertain word.s which are 
used in discussing educational tests have Ih'cu inlrodiiccd. 
The reader should study the meaning of the.se words care¬ 
fully because they will be ip:d frequently in tlie following 
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chapters, The most important of these words are: score, 
iisifihuim of scores, central tendency, median, class scores. 
In the next chapter we shall consider the meaning or inter¬ 
pretation of scores and bow to correct the defects revealed 
by the tests. 

QUESTIONS AND TOPICS FOR STUDY 

1. Whflt is silent reading? Wkt is oral reading? Which in the more 
important? Why? 

2. What are the essential features of Monroe’s Standardized Silonf 
Heading Testa? 

8, What are the essential features of Courtis's Silent Rcadinc 
No, 2? _ 

4. What is a distribution of scores? 

!. What is the median score? 

0, How is the median score found in using Monroe’s Standardized 
Silent Reading Tests? 

7. Why should a vocabulary test he used? 

8. Have you been satisfied with your marking of pupils in rending? 
How have you tested pupils in rending? Do you think you have done 
it as well as you could by using the tests desiTibed in this chapter? 

8. Have you been placing loo miich emphasis upon oral reading? How 
could you find out? 



CHAPTER m 

THE MEANING OF SCOIIF^S AND CORRECTING DEFECTS 
IN IIEADLNG 

I. Mokhob’s Standardized Silent Reading Tiwtr 

Standards necessary to give scores meaning. Seven 
seventh-grade pupils made the scores in Table V when given 
Monroe’s Standardized Silent Reading Test in April. Al¬ 
though it is obvious that certain of the.se .scores are larger 
than others none of them mean very much until \vg knetw 
what scores a seventh-grade pupil .shouhl make. That i.s, 
standard scores are necessary for iiilerprcling the scores of 
pupils or classes. 

Table V. Showins Sooue.s ov .Sevk.v Seventii-Giude Pupils on 
Monroe's STANDAitnizEU .Silent IIkadino Tiar. 


IHtpH 

Comiirchnuhn tcare 

Mui«Kvn 

A.M. 

SS.O 

MS 

E, A, 

!ir.(J 

im 

C.S. 


140 

H, n. 

ii.H 

14(1 

11, H. 

17.8 

83 

E. S. 

li.li 

34 

E.II 

11.8 

au 


These tests have been given to several thousand pupils in 
each grade and the resulting scoras tabulated iw the scjorra 
of a class axe recorded. (Bee form on page ^tt.) From the.se 
distoibntions it is a simple matter to calculate the siTires 
which the “average” or typical pupil in each of the grailes 
makes. These scores are datidard .wr«. Table VI gives the 
standard May scores for these tc.sts; that i.s, tlie scores which 
the "average” pupils completing the resi)ective grades 
make. When the tests are given at the beginning of the 
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school year, one would use the standards of the grade below 
for judging the pupils’ scores. In case the teats are given at 
some time during the school year, say at the end of the 
fourth month, approximate standard scores for this date 
can be calculated from the facts of Table VI. 


Tabub VL. Sianbabd May Scores for Monroe’s Standardized 
Silent Heading Tests 


Grade... 

Comprehension 
Kate. 



leill 

.III 

IV 

.0.0 

14.5 

.00 

80 


V VI 

21.0 21.0 

i)S 02 


Tettrx 

VH vin 

24.0 27.5 

1U2 lUS 


The seventh-grade scores in Table V were obtained by 
giving the teats April 16 which is about the end of the eighth 
month of school, but since the difference between the sixlh- 
and seventh-grade standards is not large, wc can use the 
May standards without introducing an appreciable error. 
Pupil A. M. (scores 35.0, 146) is distinctly above standard 
in silent reading ability as shown by this test. Pupil E. A. 
(scores 27.6, 98) is above in comprehension, but slightly be¬ 
low in rate of reading, Pupils C. S. and 11. H. (scores 23.1, 
146; 22.8, 146) are approximately standard in comprehen¬ 
sion and read very much faster than the standard rale. The 
other three pupils are below standard in both comprehension 
and rate. Pupil E, R. (scores 11.8, 98) is close to the stand¬ 
ard in rate, but his comprehension score is less tlian half of 
the standard. Pupil E. S. (scores 14.6, 64) reads very slowly, 
which makes impossible a high comprehension score — al¬ 
though he did only two exercises incorrectly. Thus stand¬ 
ards make it possible for a teacher to give a meaning to each 
score. 

Interpreting scores by graphical representation. Some 
persons grasp the meaning of facts more easily when they 
are represented graphically. These standards and scores 
are easily represented by distances on a straight line as 
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shown in Fig. 7. In this figure the standards for f irndo.s 0, 7, 
and 8 are represented i)y distances on the two horizontal 
lines. In each case the scale has been chosen so that the 
sixth-grade standard for rate (9:2) is directly under the ooiu- 
preheiision standard (£1). Tlic .same hn.s laicn done for the 
seventh- and eightli-gradc sUuidards. Thi.s plan produces an 




Fia. 7. Snowroa a Scuemr foutuk f’in\rnicAt. llKrar.HKCT.ATioNcwTnK 

Sconr-a or Moniior'h .S'l'ANnAHiiiznii Sii.knt Hkaiuso Truth. Ihiwkb 

TtamiE anows tub Scoues of I'ovu SEVKSTii-tiiiAia; PcritA, 

irregular scale, but lia.s the advantage that the statidarda 
for any grade lie on a vertical line. In llic figure lines have 
been drawn to repro.scnt tlie s«)ro.s of four pupils given in 
Table V. 

In the case of pupil E. A., for example, a glanw at the 
figure tells us that lie read.s silently with eighlh-grtuU', abil¬ 
ity, but his rate is .sligliLly le.s.s than scvcnth-grutle standard. 
Pupil E. 11. roatl.« as rai)idly, but i.s conspicuously below 
sixth-grade standard in cx)nii)rchcn.sion. One advantage, of 
this plan of graphical rcprci-sentation i.s that it gives a mean¬ 
ing to the amount of dilfercnce helwwn the .seort; and the 
standard. It means more to say that a pigdl is two grudi's 
below standard than to say his sc.nre is SI when the standard 
is 27.5. 
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Interpreting class scores. After the scores of the pupils in 
a class have been recorded on the class record sheet, the 
median score of each distribution is found. The median 
scores are the “class scores.” (See page 29.) The.se are in¬ 
terpreted in the same way as the scores of individual pupils. 
IHowever, one should remember that since the median rep¬ 
resents the “average” or general status of the group, devia¬ 
tions from the standards will not be so large as the devia¬ 
tions of individual scores. Thus a difference of a few units 
between a standard and a median score is much more sig¬ 
nificant than a similar difference in the cose of the scores of 
individual pupils. 

II. CouBTis’s Silent READiNa Test No. 2 
Standards. The standard scores for Courtis’s Silent Read¬ 
ing Test No. 2 are printed on the class record sheet. Tliey 
are reproduced in Table VII. They are to be used in the 
same general way as the standards for Monroe’s Stimdard- 
ized Silent Reading Tests in the interpreting of both indi¬ 
vidual and class scores. These standards represent the per¬ 
formance of the “ average ” or typical pupil in the respective 
grades. The plan of graphical representation described 
above may profitably be used here also. 


Table VH. Standabd Scores for CoimTis's Silent Readino 
Test No. 2 


Grade..,..... 

.11 

III 

IV 

V 

VI 

"Worda per minute. 


113 

1*5 

168 

101 

Queations ia five minutes. 

. 16 

24 

30 

87 

40 

Index ol comprehension. 


78 

80 

03 

05 


Interpreting individual scores. In Folder D, Series R, 
Courtis gives the following suggestions for interpreting 
pupils’ scores obtained by using his test. 

Three types of comprehension scores are possible. 

(A) Large negative indices. 

(B) Zero, Email positive, or negative indices. 

(C) Large positive indices. 
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The general moaning of those is as follows: 

(A) The child misreads. That i.s, ho not only fails to tsmiprc- 
hend what lie road.s, hut ho iHT.sihtont ly gels llio (►piso.Uc 
meaning from that in the wontom-o. 

(B) The child is guessing iit the answers and is imt rending 
at all. IRpeat the test willi apjmiprinto oxnlanaliiui* tmtil 
you arc .sure ho umiorstandN what is wanted. Tliou nioasun; 
him again, using n now form of tiio tost. Two forms Iwvo 
been printisl: The Ivitloii 'tVho I’layisl Mny liiioon (Form 
I), and Tile Kitten Wlio Wont to «. I’ionio (Form II). 
Order by form uumlxT. 

(C) All other .scores are to la' intorpret«si in the light of the 
relation between rate of rolling and the rate of onswor- 
iug que.sUon.H. The general w'liome is n.s follows; 

High and low mt«m higher or lower than the nuslian msiro of 
the class. 


Scores InlrrptritUinn 


Typi 

Jlatf 0/ 
reading 

Male 0 / 
anwrring 
queHioM 

Mrzff/ 

hcntinin 


1 

High 

High 

High 

^tnrk••d Bhillly. 

2 

High 

Higl. 

Ia)W 

Xootls training in nn nmc}-. 

S 

High 

Low 

High 

Hrfwt in tnri'littniial »kill otfirt 
by intelligent rf-rrin!ing until 
meaning i« nniniirehemle*! 

4 

High 

lanv 

I<ow 

I’cair traiiiiiiK or fwior tthility. 

5 

Low 

High 

High 

Cautious, tarrfiil reading on first 
trial, yiieh ebihlrru usuidtj' 
make inui h higher luttmt on 
iMssintl trial. 

H 

Low 

High 

Ia>w 

Mnrkisl hiek of inlelfigrane 

■ 

Low 

Low 

High 

Ijiek of native abiiiiy, tad g^tTwl 
Iniiriing. 

8 

Low 

Low 

Low 

Lttek of native al.ilily, or nuwkr*! 
defects in training. 
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Interpreting class scores. To assist one in interpreting 
the class scores of a building or of a school system, Courtis 
has devised the graph sheet shown in Fig. 8. Tins device 
shows in a very effective way the median scores for “ Ques¬ 
tions answered” and “Index of comprehension” of an entire 

I Index of Comprehension 


'20 30 40 so 60 70 80 fiO 100 



Smnt Reading as detekhinkd bv tub Courtis Siuknt Hbadinq 
Test No, 2. {Table VIII.) 


For each c 1 & 4 fl,Tciove n pencil up, bubnottouebinK, the nculo for ciUMlIoufl annwcrcd at tho 
left of tbe figure until a point la reached corresponding lo lUo cliuui nctirc for queftlloni) nn< 
o'wered. Then move tlio pencil purallcl to the ac{U« for index until a [K)int ia reachcfi which 
is directly below tha point on the scale corrcspoaditig lo Lho index (or the class. Finally 
lower the pencil to the paper at this poinl; and make nil X. Join ouch X Lo Lbo next by a 
straight line* 

In the figure an X has been drawn to reproocnt the acorcflt quoatlona answered and 
85 per cent index. 


building. The circles through which the dotted line passes 
represent the standard scores. They are joined by the line 
so as to aid one in comparing their position with the position 
of the scores of any class. The directions for drawing this 
graph are ,r.euroduced just below the figure. The position of 
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the X’s tlirough which the solid line passes represents the 
scores given in Table VIII. Among the tilings which this 
figure tells us the most obvious are; (1) The second gra<le is 
noticeably above standard in ‘Tndc.x of emnprebension,” 
but slightly Iielow in number of (luestions answered; (‘i) tlit; 
sixth grade is above in bolli abilities, parLicnkrly in number 
of questions answered; (fl) the thir<l, fourth, and fiflh grades 
are near standard; the fifth grade is exactly standard. 

TAnnn VIII. Tun Scokeh op O.vn ScircKin 


Grade. 

. II 

III 

IV 

V 

VI 

Questions answered... 

. in 

20 

82 

90 

iiO 

Index of comprelicn.sion. 

. 00 

70 

02 

04 

08 


III. Thorndike’s Visuai.. VooAiiunAUY Rcade 
Standards. This scale has not been sati.sfttctorily stand¬ 
ardized, but we give in Table IX the average score for eight¬ 
een cities in Indiana’ and for Loui.svillc, Kentucky.® 'riie.se 
scores are based on the u.se of another vocabulary scale ■which 
is supposed to be equal in diflicully to the one described on 
page 36. Thus the fac:ts of Table IX may be ased as tenti^- 
tive standards for interpreting individual and class scores. 

Tabus IX. Median Scourw in Vihuau Vocabuuary 
(Thoiindikk Scaue A) 

Grade. Ill IV V VI VII VIII 

EighLccn Indiana cilica4,00 B.iO O.ld) 0.00 7,lW 7 81 

Louisville. 4.4 fi.3 0.4 7.1 8.2 

rV. Quay’s Oiun llBADiNa Test 
Standards. The standards for this tost arc given in Table 
X. It will be noticed that after the third grade the increa,se 

’ Ilnggerty, M. E., Tim AUlUy to ReoA; Iln Afiwnremcnl and Idnms 
Faolon Conditioning ll, Indiana University Ktiidies, vol. tv, no. 84. 
(January, 1917.) 

* Race, Ilcnriette V„ "The Work of a I’aydiohiKical Lnburatory, Ed> 
uoational Administration and Supermsim, IdepLeaiber, 1017. 
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in the standards from grade, to grade is only one unit, except 
in tlie seventh, where there is a decrease from the sixth. This 
condition is caused by the particular way in which the scores 
are computed, and does not mean that a pupil reads orally 



Pia. 0. Showinq a Schbmh ron tna Ghamticai. RBrnKOBOTAWON o» 
ScoBBS ON Cray's Oral Rbadino Ticsx. {After Gray.) 

no better in the eighth grade than he did in the ilftih. This 
apparent inconsistency in the scores for the several grades is 
corrected in the plan of graphical representation shown in 
Pig. 9. The vertical line for each grade has a .scale which 
begins at a different height. The position of the broken line 
represents the sta,ndaid scores. This diagram may be used 
for interpreting either individual or class scores. 
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Tabiib X. Standard Scores fob Giut's Oral Reading Timt 

Grade. I R IR IV V VI VII VIII 

Standard!. 31 43 40 47 48 49 47 « 

V. CoRnECTING Dbb'ECTS in SiIvKNT Rbadino 

Scores furnish a basis for improving instruction. In (iwlcr 
that the greatest ixinefit may Iki dcrivcil from the use of 
standardized tests, it is imiKirtant that tho»(> lutirig them 
understand the purixtsc of such tests, Tlieir function is to 
furnish reliable information coiKHirning what pupils are able 
to do in a certain field, such as silent reading or oral reading. 
The mere giving of the tests docs not increase the abilities of 
the pupils, but when a teacher knows the abilities of his 
pupils and the standard scores for their grade, he ha,s in¬ 
formation which will be very helpful in iilanrnng future 
instruction. In the following pages we give records of I he 
scores of a few typical chusses and suggestions for improving 
the conditions rcprc.sentcd by these .scores. The first three 
illustrate scores obtained by lusing iVronroe’.s Standardized 
Silent Reading Tests and the next tsvo illiLstraU; .scores ob¬ 
tained by using Courtis’s Silent Reading Test No. 2. 

Typel. Below standard in comprehension. The first typo 
which we shall consider is that of a ('lass whicli la eonspicni- 
ously below standard in aimprehcnsion as shown l>y hton- 
roe’s Standardized Silent Reading Tt'sts, The scores of sueli 
a fifth-grade class are shown in Fig. 10. The fifth-grade 
standards are: Rate 08, Comprehension 21.0. The intervals 
in which these standards fall are indicated in Fig. 10, 'The 
class score for rate is slightly IksIow standard, hut tins js a 
minor matter compared with the position of Uic compre¬ 
hension scores. 

Individual differences. Another very noticeable feature of 
Fig. 10 is that the scorc.s arc widely scattered, which means 
that the pu nikodlhis clas s which have been grouped to- 
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^omprebenston Soor« 


Iniorvol 


Iifombar 

ol 

Fujillfl 


Iniarrat 


Above 130 
12S to 130 
121 to 13B 
lltt to 120 
111 to IIB 

100 to 110 

101 to 106 
.60 to 100 
61 to 96 

80 to 00 

81 to 
7« to 
11 to 
68 to 
61 to 
66 to 




66 






.J. 

::xi; 


so ft above 
70 to 79.9 
60 to 89 .9 
60 to 59.9 
46 to 49>9 
40 to 44-9 
36 to 39.9 
30 to 34,9 
27 to 29.9 
24 to 20.9 
21 to 20.9 
18 to 20.9 
16 to 17.9 


Number 

ol 

Pnpllii 




jT 


T 

"I. 


ifl t.n nn 


13 to 14.9 


41 to 46 


11 to i«,9 

. 

'...J . 



8 to 10.8 

. .it.... 

31 to 86 


7 to £.9 


26 to SO 


6 to 6.9 

_. 

21 to 


4 to 4.0 

j . 

IQ to 20 


3 to 3.9 


11 to 16 


2 to 2.9 

. 

0 to 10 


1 t« 1.9 


0 to 6 


0 to ,9 


Total 

/V 

Total 


Median 

8i 

1 Median 

n,7 


Via, 10. Showinq ihb Scokeb or a PinM-GBAMi 
Class on Monroe’s Siandabdizbd Silent; 
Heading Tests. {Typel.) 


gctliGr for instruc¬ 
tion do not possess 
ccpial ability in si¬ 
lent reading. In 
fact they are shown 
to differ very wide¬ 
ly. This condition 
is not imasual, but 
the pupils of some 
classes are found 
to be more closely 
groupedthan others, 
and we may say 
that while it prob¬ 
ably is not possible 
to eliminate indi¬ 
vidual differences 
altogether, a close¬ 
ly grouped set of 
scores is one ‘'ear¬ 
mark” of good 
teaching. Individ¬ 
ual differences will 
be considered more 
fully under Type 

m. 

The causes of a 
lack of comprehen¬ 
sion. The teacher 
of the class whose 
scores are given in 
Fig. 10 faces the 
' problem of improv¬ 
ing their ability to 
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comprehend. The lack of coinprclicn.sion may lie due to 
one or more of several caiuse."?; (t) A lack of a Kf)od “ iinTliod ” 
of reading silently, (a) A luck of practice in reading 
silently with cure due (u) to iii.suflicieiit opiK)rl>mity or 
(6) to the absence of a strong motive, (d) Not Hudicicntly 
acquainted with the vot;ahulury. (4) iSIi.scellaneoits eau.w.s, 
such as becoming confased on the test or failing to under¬ 
stand what is to bo done. If the teacher esercdse.s can; 
to follow the directions in giving the le.st .sueh tyiuses as 
this are unlikely to hapiK'ii for the entire ehus.s and lieiiw 
do not need to he considered in this place. 

Diagnosis, or locating the cause of poor comprehension, 
(o) Vocabidanj. In the case of a givtuj (dass it will be neeca- 
sary for the teacher to determine whicdi of the above caiuses 
apply. He will frequently be able to do tbi.s aimply by 
reason of his nequaintanet; with the pupils. If he is 
doubtful, Thorndike’s Visual Yoeahulury Test intiy la; ttsr’d 
to determine if the poor eompnihension is due to the lack 
of vocabulary, or, if lliis le.st Is not available, the teaeher 
may select a list of words from the oxerrdws rentl and a.sk the 
pupils to define them and to us<‘ them in wmteuwa. This 
may be done either orally or in writing. 

{b) Method. Evidence of a i«tor ” method " of reiuling will 
be found In the eharueter of the imjal’s rt',sjM)nw'.s to the 
exercises. EfRcient silent remling involve.s tlirta; steps: (l) as¬ 
signing to each word or iihruse it.s corrtaT meaning: {t) com¬ 
bining the several elements of meaning, giving to each its 
proper weight or signifieanec; (!t) verifying or comparing 
the meaning (in the ea.se of Monroe's Standardizc'd Hilent 
Reading Tesla, the answer to the (juestion) with the «‘n- 
tence or cxerci.se to .sw if it is the eorreel meaning. Some 
pupils do not go through tho.se .step.s. Tliey men!ly “fish 
around” in the exorci.so for a word or jiliraw' to use os the 
answer to the quesLion. This is not reading; it is only guess- 
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ing and not a “method” of rending. Evidence of this pro¬ 
cedure will be found in the pupil’s responses. If they are 
uniformly unreasonable or absurd, it is reasonably certain 
that the pupil is “guessing” or writing down the fhst thing 
whieh comes into his mind unless he is very deficient in 
vocabulary. 

An illustration of " guessing ” in silent reading. Some¬ 
times it is wise to secure further evidence. Thi.s can be done 
by requiring the pupil to answer questions based upon a 
paragraph such as the following: ‘ 

In Franklin, attendance upon school is required of every child 
between the ages of seven and fourteen on every day when school 
is in session unless the child is so ill os to be unable to go to school 
or some person in his house is ill with a contagious disease, or the 
roads are impassable. 

1. What is tlie general topic of the paragraph? . 

2. How many causes are stated which make absence excusable? 

3. What kind of illness may permit a l)oy to stay away from 

school, even though lie is not sick himself?... 

4. What condition in a pupil would justify his non-attendance? 


The following answers to the above questions by .sixth- 
grade pupils are taken from a report by Thorndike* and are 
typical of responses which indicate that the pupil is “guess¬ 
ing” at the answer to the question, either on the basis of 
what the paragraph or some word in it suggests to him or on 
the basis of his general experience. The number following 

paragraph and the questions ore taken from Tliorndiko’s Scale 
Alpha J, Part II, Set V. ITiis scale may lie purdmsed from tlic Bureau of 
mlications. Teachers College, New York City. A similar test, arranged 
m a more convenient form for classroom use and called the Minnesota 
boale Beta, may be secured from the Bureau of CoUperative Research, 
University of Minnesota, Minneapolis, Minnesota, 

, ’ Journal qf Eduoatwnal Psychology, vol. 8, p, SW, June, 1917, 
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the answer is the number of limes it oeeurrecl r>er hundred 
papers. (Two lumdred pajwrs were examined.) 

Question 1. 

Franklin. 4 1/2 

Franklin attends to his school... 1/2 

It was a great inventor. 1/2 

Because it’s a great invention. 1/2 

Question 2. 

If the child is ill...2 

Illness. 1 

Very ill.....-.3 

An excuse... 2 

Question 3. 

It Mother is ill. 5 1/2 

Headache, ill. 1/2 

A sore nock. 1/2 

When a bahy is sick. 1/2 

When the roads cannot he used... 1/2 

Question 4 

By bringing a note. 0 

To have a certificate from a doctor that tlie diw-iuH! Is 

all over. 1/2 

Tom shoes. 1/2 

Wlien he acta os if he is innocent. 1/2 

Being good. 1/2 

Get up early... 1/2 

Come to scluK)l.. 1 1/2 

If ho lost Ins Icsson.s. 1/2 

Truant.1 

If some one at his house has a eontiigioiMi diwnse.....0 1/2 

Not smart.... 1/2 

By not slaying home, or i)lay!ng hookey.. 1/2 


An illustration of failure to verify meaning. In some eases 
the answer.s to questions indicate that the puinla are not 
"guessing,” but are inacciuale l>ccau.sc they fall to verify 
or compare their answer with the paragraph rcatl. Ohviotisly 
this step was not taken by tlic pupils who made the answers 
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quoted above, but they committed another error. They did 
not try to read. They simply “guessed” or took the first 
idea which came into their minds and did not even ask if it 
was sensible or foolish. But such answers as the following 
suggest that the pupil “tried” to read but failed to answer 
correctly, partly because he did not verify his answer: 


1 Question 1. 

The attendance of the children. 1/2 

School.7 1/2 

About school.4 

How old a child should be. 1/2 

Question 3. 

Serious. 1/2 

Contagious disease, roads impassable.1 1/2 

Question 4. 

Somebody else must have a bod disease. 1/2 

Illness, lateness, or truancy. 1/2 


Thorndike says: 

Reading may be wrong or inadequate because of failure to treat 
tbe responses made os provisional and to inspect, welcome, and 
reject them as they appear. Many of the very pupils who gave 
wrong responses to the questions would respond correctly if con¬ 
fronted with them in the following form: 

Is this foolish or is it notP 

The day when a girl should not go to school is the day when 
school is in session. 

The day when a girl should not go to school is the beginning of 
the term. 

The day etc.is Monday. 

The day is fourteen years. 

The day is age eleven. 

The day is a very bad throat. 

Impassable roads are a kind of illness. 

He cannot pass the ball is a kind of illness. 

They do not, however, of their own accord test their responses 
by thinkmg out their subtler or more remote implications. Even 
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very gross violations against common sense are occasionally 
passed.^ 

Reason for failure to verify meaning. In another idace 
he comments upon the general reason for Lliis: 

There seems to bo a strong tendency in liuman nature to ampt 
as satisfactory whatever ideas arise quickly — to trust any course 
of thought that runs along fluently. If tlu! question makes the 
pupil think of anything or if he finds anything in the paragraph 
that seems to belong with the question, he aecefits it without criti¬ 
cism. Wrong answers arc, in reading tests with all ages, ttsi fre¬ 
quent in comparison with admi.ssions of ignorance. This holds of 
tests in other subjects also. 

It seems probable that in scoring pupils’ work in scluails an 
admission of ignorance should not be penalizcsl n,s heavily ns an 
absurd or specially harmful error, and that inader|uaeieH anil errors 
m general should be penalized somewhat more heavily than they 
now are, at least in the many coses where it is much more u.scful 
TO know that one docs not know and to say .so, than to respond 
wrongly. On the other hand, a mere chronic suspicion and .skep¬ 
ticism concerning one’s irleas is undc.sirahle. It is healtliy to trust 
the ideas which the laws of habit produce, provided we maintain 
an active watch for other ideu.s winch may tell wlietlicr the first 
ones are appropriate. Tlic pupil sliuuld leam to criticize his re¬ 
sponses, but not to be frightened into a meuUd iiaralysis,* 

An illustration of the lack of vocabulary. Tlic lack of 
vocabulary is indicated hy such rcsi>onH 08 to the first ques¬ 
tion of the exercise on page 64 ns tlic following: 


Question 1. JPeramlt 

A few sentences... 1/2 

Made of complete sentences. 1/2 

A sentence, that made scn.se. 1/2 

Subject and predicate. 1/2 

A letter. 1/2 

Capital.5 1/2 


1 Journal of Educoiionol P»ycholofy (June, 1017), p, 330. 

^ Elomeiitary School Journal (October, 10171 vol. 18, p. 107, 
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p£r cflrrt® 


A capital letter.... ■ .. 1/2 

The first word. 1/2 

Leave half an inch space.2 1/2 

The heading. 1/2 

Period. 1/2 

An inch and a half... 1/2 

An inch and a half capital letter.... 1/2 


How to correct such defects, x. Motivation. Pupils who 
are “reading” in the ways described on the preceding pages 
must, first, be caused to desire to read better, that is, their 
silent reading must be motivated more strongly; second, they 
must be given practice in careful reading by the teacher 
making use of and creating situations in which emphasis is 
upon thought-getting and not upon oral expression or rate 
of reading- 

Sileni reading moUvaied by the use of standardized tests. It 
has been the experience of many teachers who have used 
standardized tests that a strong motive is frequently created 
by telling the pupils tlie standards for their grade and the 
scores of their class. This gives the pupils a definite aim to 
work for and a statement of the progress which the class 
must make. It secures for the teacher the cooperation of 
the class, which is very important. The writer has visited 
classrooms where the teacher had the class scores and the 
standards represented graphically on a chart which was 
posted in the front of the room. If the class was below stand¬ 
ard, the pupils were interested in having the class scores 
brought up to standard. 

Commendable results have also been secured by having 
each pupil compare his scores with the standards. This 
stimulates the pupil to compete with an objective standard 
and not with his classmates. Thus the undesirable feature of 
competition is eliminated. If tlie tests axe repeated from 
time to time, the pupil also has the advantage of comparing 
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his successive scores. He thus learns the amount of his 
progress. The teacher should bear in mind tliat probably 
all pupils will not attain the standards and that some will 
exceed them. A pupil who is below standard, but is making 
progress, may be doing all that i.s po.ssiblc for him in the 
time that is devoted to reading. If he is, the teficher must 
make certain that he does not bceomo discouraged. 

2 . Emphasis upon thought-getting, (a) hi i}ie primary 
grades, Children in the primary grades should from the start 
have exercises in wJiich the meaning is the only significant 
element, and tlio respon-se is not in terms of words said, but 
things done, or interpretations made. For example, lot it 
be the usual thing for the child to carry out the directions 
contained in the word or sentence. The primary teacher 
should be supplied with some hundreds of curds upon which 
such sentences or short paragrai)hs os the following are 
printed or written: 

(1) Draw a picture of a flag on tlio l)Ia<’kboiird. 

(2) Make a sound like a cross kitty makes when a dog chases her. 

(3) Hide behind the door. 

(4) Play that you are carrying a cup full of water and do not 
wish to spill any of it. 

These cards shoiUd be graded in such a way that certain 
ones will contain only the words taught in the first reading 
lessons. As more worcla are learned, more cards will l)ecome 
available. Variety in luuidh’ng the exercifK.'s may be intro¬ 
duced in scores of ways whicli will readily occur to a re¬ 
sourceful primary teacher. Many other devices having the 
same aim will also occur to the teacher. The essential thing 
is that practice m translating written or printed language 
into action instead of words should be started curly, tlms 
producing tire habit of advancing through a paragraph by 
thought-units rather than by letters, syllables, or words. 

(b) Above the primary grades. In grades above the primary 
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the problem is fundamentally the same as stated for the 
primary, but the devices must vary. 

First, whenever reading is done orally, be sure that what 
the child is reading is new to most of his listeners. Be sure, 
too, that the other pupils are listening, and not following 
along with the reader in another copy of the same book. No 
method of reading is more faulty in intermediate grades 
than that in which other members of the class are watching 
for a word error of the reader, ready to call attention at once 
to such a mechanical mistake. This method centers the at¬ 
tention of the reader constantly upon the mechanics and 
never develops the habit of attending first to the thought. 
Whereas, if the reader realizes that his hearers know nothing 
of the content of his selection except what they gather from 
his reading, then giving the thought instead of pronouncing 
the words becomes the controlling factor in his conscious¬ 
ness. It follows from this that only selections, the thoughts 
in which are vital to children, should be used as subject- 
matter for such reading. Then let the one who has read such 
a selection defend the selection against questions or criti¬ 
cisms of the class. In short, center attention upon the mean¬ 
ing, even at the expense, if necessary, of accuracy in pro¬ 
nunciation, enunciation, and expression. 

Second, let the amount of reading which is compellingly 
interesting be increased. Supplementary reading in geog¬ 
raphy, history, science, and literature should be given a 
larger place. Require that the reports made upon such read¬ 
ings be rather exact, but let the selections be reasonably easy 
for the children. Gain in facility in silent reading cannot be 
secured by holding the children to selections which are so 
difficult that word-troubles absorb all the attention. One 
must be able to go witlr ease through the successive 
thoughts before the habit of attending to the thought can 
be acquired. 
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Third, make all the industrial and playground cxorc-ises 
give a far greater measure of service in teaching reading Ilian 
they now commonly give. How .singularly .shorl-siglited 
we are to ask a child to follow the directions iirintcd in his 
arithmetic for finding the per cent that one numher is of 
another, but employ a teacher to give orally Ihe (lirecliori.H 
for playing a new game, making a raflia basket, or iilant- 
ing beans. The very things which come nearest the natural 
interests of the children, eonecniing which they would mo.st 
zealously read if they had the paragraplis containing the 
needed directions, arc given to them orally. When interest¬ 
ing school exercises require a careful following of directions, 
then those directions make the most offcctive silent reading 
material. But in practice we .seldom make u-se of them 
This fault is due to a failure to imdcr.sland the distinction 
between the aim of the intermediate grades and the aim of 
the upper grades. If we realized that all the work of the 
intermediate grades should be made to deveh»p skill in using 
tlie tools of learning, then wc should not eonducit these exer¬ 
cises without making them aid in teaching reading. 

(o) In the upper grades. Fjussing now to the situation pre¬ 
sented when the score of a class above intenncdialc grades is 
found to be low, we Imvc the most serioius task of all. The 
junior high-school or upper-grmle pupil should l>c able to 
proceed with his school tiusk.s mlhout much attention to the 
tools he is using. It in not the primary fimclicm of this de- 
pai’tment of the school .system to incroa.se the children’s fa¬ 
cility in the handling of thc.se tools. However, sucicess in 
nearly all the tasks imdertakcn in the uppe,r grades dei>ends 
upon the skill which the children are expected to po.ssess in 
the tool subjects. A compromise is, therefore, necessary, if 
children in the junior high school or seventh and eighth 
grades, are found deficient in their ability to read silently. 
A few suggestions are here ollered in the hope that some help 
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may come from them, although it is realized that correcting 
reading faults at this stage is very difficult. 

First of all, the children’s own conscious efforts should be 
obtained in the direction of correcting the faults. Then, too, 
the teacher should see that he is observing the same funda¬ 
mental principles stated for the intermediate grades. Com¬ 
prehension, and not mechanics, must be made the test of all 
reading, whether in history, science, or literature. The ma¬ 
terial selected for use must bo sufficiently easy so that the 
children are not tied up in word or language difficulties. 
Again, to overcome the habit of proceeding by too small 
units, practice must be afforded in advancing by short sen¬ 
tences or phrases. 

In ease the trouble seems to be that the children read 
fluently enough orally, but get little of the thought, intro, 
duce a great deal of the sort of reading requiring close atten. 
tion to the thought. For example, use rule books for foot- 
baO, basket-ball, and the like for those interested in games; 
catalogue descriptions; directions for making certain 
stitches; the more involved arithmetic problems; and so on, 
These things possess a minimum of word-difficulty and a 
maximum of thought-difficulty. They require the imagina¬ 
tion to construct a picture little by little and hold it up for 
constant modification as the reading proceeds. Thus, attem 
lion is focused on thought. 

Where the class appears to have the right habits of reading 
silently, but have had insufficient practice, the obvious sug¬ 
gestion is to give them all the practice possible. Much sup¬ 
plementary reading upon which they make only meager 
reports, if any , will help. Try to secure as much general home 
reading as possible. See that an abundance of interesting 
things is available for reading, and stimulate interest by hav¬ 
ing the children’s criticisms of them given before the class. 

. 1 . Exercises requiring careful reading to answer ques- 
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tlons. Exercises of the kind shown on paRc 54 can he used 
to an advantage in teaching pupils to eomirndjeml wliat they 
read. Exerci.sea may he taken from the te.sts menlinnefl in 
tlie footnote, hut a teacher will not find it dillicult to eon* 
struct similar ex'erc:i.se.s l)y asking a .serie.s of question.-i ha.'-eci 
upon paragraph.s in the impils’ geography, history, or other 
texts. If supplementary rca<ler.s are nvuilahle, tliey <‘Ui» also 
be used in tliis way. Tlie teaelier can write tlie fpieHtiftns on 
the board or dictate them. Tlie next day the i>ai>er.s .should 
be returned and the attenlion of tlie pupils ealled to their 
errors. This plan can Iw varied hy having the pupils turn 
to a particular paragraph in their text anti prepaw' an ajv 
propriate set of que.stions on it. The teacher can judge the 
questions upon the basis of whether they call for the, iuiiKtr- 
tant ideas in tlic paragraph. 

The ase of ,sueh exerei.se.s tltK'.s two tilings: first, answering 
the questioms will give the jiupili an itlea of what ean-ful 
reading involves; .see.ond, their attention will 1 h' directed to 
the necessity of verifying their an.swcr.s. 

4 . More attention to vocabulary. If the eauH* is found to 
be a lack of acquuinlanw. with the ineuning of the words 
used, more attention .should lie given to vocalmhir^'. In the 
upper grade.s the u.se. of the. dielimiary will help, hut the 
most important thing i.s that the teaeli(*r .shall definiU'ly 
recognize the ncees.sily for Icuehing Hut meaning of wonls, 
not merely formal dictionary (lefinilion.s, Init rich, rxmiprc- 
hensive meanings whie.li are dintelly connected with the ex¬ 
periences of pupils. It i.s frequently worth while* to .sfauiel 
five or ten minutes in a ela.sa <li.H<‘iLs,sinn of the inemnng of 
an important word. The ilsc of a vocabulary test will teml to 
direct tlie attention of Die teuclier to Hie nefs'.sHily for doing 
this. It may also hapjixm Uial when the. pujiit finds that he 
is below standard in vocabulary Ids cotiiMjratiou ivill bo 
secured. 
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Fig, 11. Showing the Scores or AFotniTn- 
Gradb Class on Monroe’s Standardized 
Silent Reading Tests. {Ty‘pe II.) 


5 . Providing op* 
portunity for prac¬ 
tice in silent read¬ 
ing. This point will 
be discussed more 
fully under Type 
III, but attention 
should be called to 
this means of im¬ 
proving the ability 
of pupils to com¬ 
prehend what they 
read. Reading is 
an art and pupils 
must have much 
practice. Supple¬ 
mentary reading 
material of the right 
kinds should be pro¬ 
vided and definite 
provision should be 
made for opportun¬ 
ity to read it dur¬ 
ing school hours. 
The teacher should 
look upon supple¬ 
mentary reading as 
an important school 
activity and one re¬ 
quiring his supervi¬ 
sion. 

Summary for 
Type I. Under this 
type we have con- 

































CORRECTING DEFECTS IN READING 65 

sidered tlie case of a class wliich lias a lotv coinprelien- 
sion score. The causes coii.sidered for tlii.s condition are: 
(1) failru’e to use a {'oocl "method” of readiuK; (S) a hick 
of practice; and (.‘5) in.suffieieiit vocabulary. We have hu>^~ 
gested plans for diagnosi.s or locating the cau.se anil ha\'e 
given several tyiiical illustrations of the causes nientiniicd. 
The methods of correcting these defects luu'c been pre¬ 
sented under tlicse heads: (1) motivation; cinplia.sis 
upon thought-getting; (8) exercises rcciuiring careful read¬ 
ing to answer questions; (4) attention to xauabulury; 
(5) providing praclic'c in silent reiuling. These methods 
will be considered again imdcr Type III im means of c!or- 
recting individual defects. 

Type II. Below standard in rate of reading. In Fig. 11 
there is shown the record of a fourth-grade class wliich reada 
very slowly. The puiiils also made low score.s on compre¬ 
hension but this is due in part to their .slow rate of reading 
because when Monroe’s Standardized Silent Heading Tests 
are used a high comprehension score is impossible for slmv 
readers. 

Causes of slow reading. Three causes may lie given for a 
situation such as is illustrated in this second tyi>e; (1) the 
common belief that in order to read well one must read 
slowly; (2) over-emphasis uixm oral reading which results in 
the pupil pronouncing the word.s to himself wlien he retuls 
silently; (3) failure on tlie part of tlic teacher to recognize 
that the rate of reading is important. 

How to increase the rate of silent reading, i. Motivation. 
One effective plan is to furnish a strong motive. T’his can he 
done by using standardized tests us suggested on page .'58. 
Interesting stories or rcfcrenc-es for supplementary reading 
will often be effective. If a pupil becomes intercsled in a 
story, either by having had a part of it read to him or by 
having read the first of it himself, he will be anxious to read 
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the rest of it to “see how it comes out.” While the quality 
of the reading should not be neglected, the emphasis should 
be on the rate of reading. In order that this may be done, 
the reading material must be simple. 

2 . Emphasizing rate of silent reading by informal testing. 
One reason why pupils read slowly is that the teacher pays 
no attention to the rate of silent reading. In Chapter I we 
pointed out that one defect in our ordinary measurement of 
results was the neglect of the rate of work. The rate of read¬ 
ing is an important “dimension”' of the ability to read si¬ 
lently. In many cases a teacher can increase the rate of his 
pupils’ reading by simply recognizing it as one “dimension” 
of the ability to read. This con be done by asking the pupils 
to read silently beginning with a certain paragraph in their 
text (school reader, geography, history, or elementary sci¬ 
ence). At the end of a suitable period, three to five minutes, 
stop them and have them count the number of lines read. 
This number will be a crude measure of the rate of reading. 
This should be a part of the regular instruction in silent 
reading. If the teacher doubts the quality of the reading, it 
can be tested informally by having the pupils answer a set 
of questions based upon the lines read. 

In the survey of the Cleveland Public Schools an informal 
silent reading test was given by having the pupils read si¬ 
lently in the Jones Readers. After some preliminary testing 
to give the pupils an understanding of what they were to do, 
the teacher read aloud a page to the class, the pupils Laving 
their books open. When he came to the turning of the page 
the teacher stopped reading and noted the time. The pu¬ 
pils continued the reading silently. At the end of one min¬ 
ute they were stopped and the number of hnes read were 
coimted. The pages used for the test and the average num¬ 
ber of lines read are given in Table XI. In interpreting the 
average number of Hues given in this table, one must remem- 
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ber that tlie material read in the upper grades was more 
diflScult and that tlic lines contained more words. lie may 
use these facts ns tentiitivc standards for judging hi.s pupils 
when testing then.- rale of reading in the way suggested. 


Table XI-* Snowiwo Rate of Silent Readino in Infoiuial 
Te.stino 
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♦ Ju(ld» C. n,, " Mcttsiiring tbo Work oC Iho Srh'>oU»’' i'Miiro/ipn 

ffufttfV, p. S201. 

Rapid readers good readers. It lum eommoidy been 
thought that a thorough uudcraLuiifling required tluvl the 
pupil should read slowly and carefully, and that the rax)id 
reader understood very little of what he read. It is, of 
course, true that the pupil who reads with extreme rai)idity, 
or “skims” over the page, does not c<nnpreherui conii)Ieteiy 
what he reads, but we now have cvideiuxj which sliows that 
in many cases a rapid reader is a “good” reader and a slow 
reader is a “poor” render. 

Fig. 12 is reproduced from the Rcjmrt of tJio Cleveland 
Survey to show tlic relation which was found to exist la-tween 
rate and quality of silent reading lus measured hy Gray's Si¬ 
lent Reading Tests.^ On the basis of their st;ores 1831 jmpiLs 
were divided into the nine groups indicated in the figure. 

1 These tests are not rlesmbetl in this Ixiok liewnse tticy are not suited to 
general classroom u.sc. For a complete description of llicm the reader is 
referred to Gray, William S., ffttidicJi in lilemenlar!/ Mml /leading Through 
Standardized Teals, (Supplementary Educational Monograplis, University 
of Chicago Press.) 
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The per cent of the pupils in each group is given by the 
number inside of the circle. The size of the circle represents 
the size of the group. The figme shows very clearly that 
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Fig. li . Pbk cent of 1831 Cleveland Popils fottnd in bach 
ON Ninb Speed and Quahtv Gboupb in Silent Rbadinq. 
{From JuM's “ Measuring the Work of ike Public Schools.”) 


a rapid reader is good in quality more frequently than he is 
poor in quality and the opposite is true for slow readers. 
The application of this fact is that in many cases pupils will 
improve in quality of reading when they increase their rate. 
Teachers should not expect to secure a higher degree of 
comprehension by urging their pupils to read more slowly. 

3 . More opportunity for silent reading. Practice in read¬ 
ing is even more necessary for producing the ability to read 
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lapiclly than for engendering tlic ability to cornprehend. The 
suggestions on page 04 apply here also. It is partieiilarly 
important that the material should not be diflioulL to 
understand. 

4 . Less emphasis upon oral reading in the intermediate 
and grammar grades. Gral reading is ncee.ssary in the i)rim- 
ary grades, but as the pnpil progrcsso.s from grade to grade, 
more emphasis should be idaced upon .silent reading and 
less upon oral reiwling. Prom about the fourth grade .silent 
reading should reecivc the greater emphasis. Jf'aihirc to do 
this frequently causes the pui>il to acquire liabit.s wliieh 
make rapid silent reading impossible. Two cases of -slow 
readers due to this cause are de.scribed on pages 73 and 
84. 

Summary for Type n. Under this type we have con.sidcrcd 
the case of a class which reads too slowly. The following 
causes were considered: ( 1 ) attempt to .secure a liigh degree 
of comprehension by urging the piipils to read more .slowly; 

(2) over-emphasis upon oral reading; (3) failure of teacher 
to recognize tlic rate as important. P’or itutrciusing the rate 
of silent reading the following corrcctive.s were given: ( 1 ) 
motivation; (3) greater cmpha.si.s upon the rate of reading; 

(3) more opportunity for silent reading; and (4) Ic.ss em¬ 
phasis upon oral reading. 

Type m. Scores too widely distributed. In P'ig. 13 -we 
show the scores of a fifth-grade clus.s whose median sajres 
are approximately standard. (The test wa.s given I'ebruary 
4, and hence it is not to l)e exi>ecled that the da.s.s had at¬ 
tained the seventli-gi’ade May standard.) Tlic uolieei'hle 
tiling about this record is that the scores for rate range from 
one score between 31 and 3.7 to one above 130, and for 
comprehension from one score between 1 and £.9 to one Iks- 
tween 35 to 39.9. Thus, there are in this fifth-grade chias 
some pupils below third-grade standards (60,0,0) and otliera 
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Fiq. 13. Showing the SconBa of a Fifth- 
Ghadb Clasb on Monroe's StANDAEDizBD 
Silent Reading Tests. {Type 111.) 


above the eighth; 
grade ^ standardi 
(108, 37.6). The 
teacher’s particular 
problem in this case 
is with the pupils 
who have the low 
scores. Those who 
are above standard 
do not constitute 
a problem, if they 
are above in both 
rate and comprehen¬ 
sion, except that the 
teacher should con¬ 
sider whether these 
pupils could spend 
the time now de¬ 
voted to reading 
more profitably on 
some other subject. 
It might happ)en, 
for example, that 
some of these pu¬ 
pils might be below 
standard in arith¬ 
metic, spelling, or 

1 Accurate compntiaon 
of fiftli-grade scores with 
eighth-grade standards 
ia not possible liecause 
different testa are used 
in these grades. How¬ 
ever, the statement is 
probably true. 
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language. If so they need to devote some extra time to 
these subjects. 

The condition shown in Fig. 13 may be due to an unwise 
classification of the pupils and some adjustments should Im 
made which would reduce the wide range of scores. How¬ 
ever, this would probably reduce the nmnbcr of coses only 
slightly and the problem would still remair. 

Uniformity in instruction for all the mcml)ers of a class 
widens variability among them, making the weak ono.s rclii- 
tively weaker and the strong ones relatively stronger. To 
prevent tliia widening of the variability more attention must 
be given to individual instruction. This docs not mean a 
leveling of all members of a class, but rather affording a 
rnaximiim of opportunity to each member to do those things 
most needful to him. Those tilings which he can already do 
well he should not be required to do, even though some other 
members of the class need to do tliem. 

Those children falling far below the median of the chuss 
should be given special physical examination to discover if 
possible the cause. Sometimes eyesight is found to lie poor. 
Frequently some oLlicr physical defect lias prevented normal 
mental growth. Sometiincs an examination by means of 
approved intelligence tests, such as the Bliict-v^imon tests,’- 
reveals that the child is mentally incapable of doing work 
of the regular school type. 

Illustrations of individual defects. It maybe that the pu¬ 
pil needs to be iauglii liow to read silently. Not very much 
attention is given to teaching pupils how to rcml silently. 
The instruction in reading is confined largely to oral remling. 
A pupil who has not learned liow to read silently needs in¬ 
struction. One teacher writes of a certain i)upil as follows: 

* See especially Tcrman, L. M.. The Mcainremmit of InieUij/Mce 
(Houghton MiBlin Company, Boston, 1010), A simple guide for the use 
of the intelligence scale. 
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From the tests given and from her work in English which I hav*^ 
had for two years, I find that she has only a vague hazy kind of 
meaning for many of tlie words needed for seventh-grade work. 
She does not see words in their relation to others in the sentence. 
When she finds a name for a conihination of letters she is satisfied, 
thinking that she is reading. She has failed this year. I hope this 
may rouse her to the effort of which I am sure she is capable. If I 
can only make her see tliat reading means more tlian naming words 
and persuade her to work, I am sure she can overcome her diffi¬ 
culties. 

Another difficulty may be vocabulary. A boy who made 
a low score on the silent reading test was given the vocabu¬ 
lary test, on which he made a very low score. His teacher 
describes him as follows; 

His greatest difficulty seems to be a lack of vocabulary. Ho 
memorizes history instead of studying for the thought. Lately, he 
has gotten away from this to some extent and begins to sum up the 
thought rather than repeat words when culled upon. He still (after 
some individual instruction) finds so many unfamiliar words in any 
new paragraph that liis progress is very slow, but ho attacks his 
problem with more intelligence than he showed at first. 

How to bring individual pupils up to standard. If the 
child is nearly normal physically and mentally, but has not 
developed ability to get meaning from printed language, he 
presents a problem in instruction calling for the best profes¬ 
sional skill to solve. In dealing with such pupils the sugges¬ 
tion given for Types I and II can be used. Giving the pupil 
a strong motive frequently will solve the problem. 

It is quite certain that a pupil far below the median in this 
basic ability has never made use of printed language to se¬ 
cure help in satisfying his own childish desires. If possible, 
situations must be brought about in which his desires or 
plans depend for their fulfillment upon his reading. It may 
be, for example, that Lis mother or father has been in the 
habit of reading stories to him. If so, and he can be made to 
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be keenly interested in a story by liavinR a part of it rcful 
to him, he should have to read the rest himstdf to satisfy his 
desire to know the rest of the story. Possibly he -vvould like 
to be the leader in an oceasional nature-study extnmion, 
but, of course, it will be expected that he look up itifmma- 
tion concerning the things they see on the trip and he able 
to report later to the group. That is the bu.siiiej« of tlie 
leader. Or he might umpire the baseball game if he made 
sure of the rules; or assign the parts in the (xuning school 
entertainment, if he rend the various parts ciirefully so as to 
be able to make a wise assignment; or score the class cx)in- 
positions on the basis of wliich was most intcrosting. Such 
a list of possible opportunities for calling into servic-c a 
child’s silent reading ability might be largely extended. 
The two things to guard again.st arc (1) making rcatling a 
punishment and (2) confusing child need with school need. 
The thing to be accomplished is to give the child a chance 
to do something wliich he really wishes to do, but cannot do 
without reading. 

The case of a slow and inefBcient reader. Judd^ gives the 
cose of a girl in the fifth grade who was average or above in 
all her school subjects c.xcept reading. In tlu's one subject 
she had been rated os a poor student from Llie first tlirough 
the fourth grade. Her health was good and she bad been 
regular in her attendance at school. 'With respect to reading 
she is described as follows: 

Reading seems to be Lor greatest weakness. Her fourtli-gwlo 
teacher reported her as "a slow reader who reads hesitatingly and 
haltingly, repeating words and phrases. Her breathing is very 
shallow, often causing her to pause for brealli in tiie muldle of a 
word or phrase. Her voice is thick, heavy, and unpleasant ly nasal. 

‘ Judd, C. H., Reading; Its Nature and Development, Supplementary 
Educational Monograplia (University of Cliicago Press), vol.2, no. 4, p, 82. 
(The paragraph headings in this and the other quolationa front this toano- 
graph have been inserted by tbe author.) 
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Silent reading is particularly distasteful to her. She always settles 
down to it reluctantly and tardily.” 

From the home comes much the same story: “She has never read 
a story to hcrseU, though she has several attractively illustrated 
children’s books. She frequently, however, after eagerly studying 
the illustrations in a new book, begs to have the story read to her, 
saying, ‘You read it, mother. I can’t understand it very well when 
I read it myself.’ ” 

This pupil was carefully tested in both oral and silent 
reading. In oral reading her score was 33, while the standard 
is 48. She naade many errors, particularly mispronuncia¬ 
tions. In silent reading, she read even more slowly than she 
did orally. 

Observations made during the silent-reading tests showed that 
there was much vocalization. The reading was done in a low whis¬ 
per, and difficult words, as stated above, were spelled out letter by 
letter. She followed the line with her finger. In one of the early 
practice periods, when urged to read more rapidly, she remon¬ 
strated, saying that she could not hear the words so well if she did.^ 

The correctives which were used, l<Yom the foregoing data 
it is evident that her difficulties in rending were due to a lack of 
familiarity with printed words and a lack of method of working out 
new or unknown word-forms. In an effort to help her overcome this 
handicap she was given various types of training during eighteen 
weeks. The first six weeks were devoted to a great deal of oral 
reading. The second six weeks were spent on drills in phonics and 
in word analysis. During the last six weeks she was given a great 
deal of silent reading. While each period of six weeks thus strcKSsed 
some one phase of reading, all tliree types of work were carried 
along throughout the eighteen weeks. For example, oral reading 
was continued with Jess emphasis during the last twelve weeks. 

The selections for oral reading were made along the line of the 
pupil’s school interests in history and geography. These included 
Baldwin’s Fifty Famous Stories and Thirty More Famous Stories, 
Harding's Story of Europe, Allen’s Industrial Europe, Carpenter’s Eu- 

^ ’This is the case of a pupil whoso defect was probably caused by over¬ 
emphasis upon oral reading. The pupil had never been taught to read 
silently. fAvihor.) 
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rope, “ Our European Cousins Series,” the Merrill and the Horace 
Mann Third and Fourth Readers, Tappaii’s Old World Heroes, 
Terry’s The New Liberty, and Brown’s English History Stories. 

Phonics and word analysis were emphasized durinR the second 
six weeks. Various systems of phonic.s with some modifications to 
suit the particular needs were used. Words mi.sj)ronouncetl in oral- 
reading lessons were worked out phouetieaUy, and li.sU of words 
similarly pronounced were built up and review(sl from time to 
time. There seemed to be a gradual growth in ability to attack an 
unfamiliar word. In tlic earlier period the pupil frequently IcMtked 
at the word helplessly or pronounctsl a known syllable, but was 
unable to attack it at all phonetically. She usually asked tlic in¬ 
structor to pronounce it. Later she began immediately to sound 
the new word phonetically, and though sometimes making a mis¬ 
take in the length of the vowel or in the position of the accent, her 
manner of attack indicated that she hod confidence in her own 
ability to work it out. 

Silent reading was emphasized during the last six we<‘k.s after 
some training in silent reading had been given throughout the first 
twelve weeks. For special training paragraphs or selections dealing 
with topics of particular interest to tlie pupil were u-sed. In many 
mstanccs the original selections were edited, and tlic words which 
had been used in tlio phonic exercises were woven into the text. 
Frequently before the silent reading began a question was rais<‘d, 
the answer to which was to be fouml in the teat. Oral or written 
reproduction or a di.scussion of the thought of the selection usually 
followed the reading. It is interesting to note, in passing, that 
though no effort was made to reduce the vocalization so jicrccpliblc 
at first, it entirely disappeared except when an unusually difficult 
passage was encountered. 

The result. One of the significant results is tliat men¬ 
tioned in tlie closing sentence of the aliovc paragraph. The 
pupil had learned how to read silently without pronouncing 
the words in a whisper. After the correctives described 
above had been used, the pupil was tested again in both oral 
and silent reading. She showed a decided gain in rate of oral 
reading and a reduction in the number of errors, In silent 
reading her rate had increased so that slie now read more 
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rapidly silently than orally, whereas before this special 
training the opposite was true. At tlie same time she made 
large gains in comprehension. 

Her teachers report tliat Case G [the pupil described above] 
reads with much greater ease and fluency of expression. The 
quality of her voice has improved and the nasal tones have ah 
most disappeared. She seems to enjoy reading silently much more 
than before training. Frequently she expresses a preference for 
reading a passage silently, saying, “I can do it foster.” 

The case of a pupU deficient in vocabulary. A seventh- 
grade boy is described by Judd,^ whose most striking defect 
in reading was a lack of word meaning. He is described as 
follows: 

In general school standing he is rated as a poor student, although 
he is given a grade of good (B) in tlie manual arts, music, and phys¬ 
ical training. In all other subjects he is poor. During tlie past two 
and a half years he has received no grade higher than C in history, 
geography, science, literature, composition, and grammar. In this 
connection it is interesting to note that progress in tliese subjects 
after the fourth grade is dependent to a large degree on ability to 
get thought from the printed page. 

His teachers report him as a shy, timid boy, easily embarrassed, 
lacking in self-confidence and initiative in tlie classroom, though 
very energetic and responsive on tlie athletic field. He rarely takes 
part voluntarily in class discussions, and when called on to do so 
responds in a few brief, fragmentary sentences, badly expressed, 
but usually containing a thought or an idea on the topic being con¬ 
sidered. His English teadier finds great difficulty in getting him 
to read with any degree of expression, for he makes no attempt to 
group words into thought units. He reads in a dull, monotonous 
tone, slurring words and phrases. When asked to teU what lie has 
read, he reproduces a few ideas in short, scrappy sentences, for 
apparently he makes few associations as he reads. Bis tcachera in 
history and geography explain his poor standing in their subjects 
as attributable to an inability to get ideas from the text. He ap¬ 
parently reads as rapidly silently as any in the class, but gets and 
retains less of the thought, 

^ Judd, C, H., Reading: lie Nature and Development. Sujjplementary 
Educational Monographs (University of Chicago Press), vol. no 4, p. 100 
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The tests in oral and silent reading sustained the opinions given 
by his teachers. In the oral test he read fairly rapidly, pronouncing 
the words mechanically and enunciating poorly. . . . 

The test in silent reading definctl more clearly his apparent difli- 
culties. , . . Clearly lliis particular seventh-grade boy ranks in 
comprehension at a lower level tlian the iX)orest readers in the two 
preceding grades. This result verifies the estimates of his teachers 
of history and geography. 

A r6sum6 of the facts brought out by the tests would seem to 
indicate that he has acquired a mastery of the nidimeiitary me¬ 
chanics of word recognition, but logger! far behind in tlm ina.ster 5 ' 
of word meaning. He read words as mere names and not as sym¬ 
bols of ideas. 

The correctives which were used. How to build up a baclc- 
ground of meanmg that would form a basis for his reading was and 
still is an urgent and cliflicult problem. Because of his interest in 
animal stories and tales of camp and pioneer life, emphasis was laid 
throughout the eighteen weeks on literature dealing with these 
topics. The Boy Scouts’ Manml, Custer’s Bools aiid Saddles, Roose¬ 
velt’s Winning of tho West, Southworlh’s Builders of Our Country, 
Book n, the Morrill and the Horace Mann Fourth and Fifth Read~ 
ers, Muir’s Stickeen, Coffin's Bmjs of ’7f>, tlic Seton Thompson 
and Kipling stories, and similar literature were drawn upf)n freely. 
Silent reading was continued throughout the eighteen weeks, but 
was especially empliosized during the first six weeks and again 
during the last six we<;kH. After reading a seli'ction tho pupil re¬ 
produced it orally or in writing. The.sc reproductions at first wero 
so meager and inadetiuate Unit he frequently hofl to rc-retul several 
items before ho could answer tlic questions raised. Many seleotiona 
Were road in this way paragrapii by paragraph, and tile main points 
jotted down to assist in the organization of the thought. 

Before the work had progresscrl very for it bcicanuj apparent 
that definite word-study was neccs.sary in onler to hnild up a l«ick- 
ground of meaning. Words were studicil in the context for mean¬ 
ing, and certain ones wero chosen for detailed analysis of prefix, 
suffix, and stem. A stem-word analyzed in this manner become the 
nucleus for grouping togetlier other closely related words more or 
less familiar to the student. The word "traction,” encountered 
in an article on the “Lincoln Highway,” brought out a discussion 
of traction engines, their use in plowing, rood-building, and trench 
Warfare, why so called, etc. This centered attention upon the stem 
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“tract.” As its meaning became clear the following list was 
elaborated: 


Subtract 

contract 

detract 

attract 


distract 

extract 

retract 

contraction 


attraction 

distraction 

subtraction 

extraction 


A study of the prefixes in these words gave a point of leverage 
for attacking the meaning of words containing them. In this type 
of prefix study only those words were listed whose stems were 
familiar to the pupil; as, for example: 


recall 

reclaim 

rearrange 

regain 


rebound 

retain 

reform 

remake 


retake 

reinforce 

return 

reframe, etc. 


In a similar manner an acquaintance was made with the most 
common suffixes. 

The meaning of some words was approached by tlie study of 
synonyms and equivalent idiomatic phrases. These were, as far as 
possible, studied in the context and discussed at Icngtlx to bring out 
shades of difference in meaning. “An indomitable hero,” met in 
the pioneer tales, brought forth the following synonyms and idio¬ 
matic phrases: 


indomitable 

fearless 

stout-hearted 

brave 

heroic 

intrepid 

courageous 

bold 

audacious 

resolute 

daring 

defiant 

manly 

plucky 

undismayed 


to look danger in the face 

to screw one’s courage to the stiefcing-point 

to take the bull by the horns 

to beard the lion in his den 

to put on a bold front 

This type of intensive Word-study was continued throughout 
the first six weeks, but was supplemented by incidental word-study 
during the remaining twelve weeks. 

Oral reading was given special attention during the second six 
Weeks and continued during the following six weeks. The literature 



COERECTING DEFECTS IN READING 79 

was of the same general typo os that used in silent rearling. The 
purpose was to improve, if iwssihle, ermneiation and eKj)r(’S8ion. 
Special drills in the enunciation of vowels and of the terminal and 
initial consonants were a part of each reading lesson. Many of 
these drills were taken from reading bof)Its. Selections were studietl 
silently before being read aloud and the meaning disciis.sed. The 
various thought units were marked off and the wlujle selection was 
tlipn read aloud. Before the close of each les.sou the, pupil read a 
selection at sight, unaided by this kind of preparation. 

The result. A tc.st in oral readiiiK after lliis .special train¬ 
ing showed a reduction of fifty per cent in the number of 
errors and a gain in rate of reading. In silent reading a 
greater gain was made, especially in comprehension. 

An illustration of group and individual instruction. A 
fourtli-grade teacher ’■ has written of her experience in 
teaching reading to a cla.ss of twenty pupils by group and 
individual instruction Iniscd upon the results of testing. 
Her report is so suggestive that tve quote at some length: 

In October pupils were te.sted to ascertain the oral- and silent- 
reading rate of each individual. Five* oral and five .sihuit trials were 
made, and the averages obtained and u.scfl a.s meo-sures of rea<ling 
rate... . With but one exception the nqjid r('adera made fewer mis¬ 
takes. Comprehension was tested inforinidly. Rapidity luul com¬ 
prehension Seemed to go together. Intensive instruction was given. 
Especial attoulLon was paid to poor renders. After two weeks 
there wa.s no improvement in the rate of tlic three poorest rearbrs. 
The only noticeable iinprovemenl was made by the better readers. 
It was evident that tlie least capable were gelling the least from 
instruction, though receiving more attention. This presented a 
problem .... 

Ten types of in.struction were planned to cover as many indi¬ 
vidual needs. The class Reader was supplemented by a carefully 
selected list of books for exten.sivo reading. Metliwls wore devised 
whereby maximum effort would be called forth and interest sus¬ 
tained. Rate was found to be a measure of improvement which tlio 

‘ Zirbes, Laura, "Diagnostic Measurement as a Basis for I’roccduTo"; 
in Elementary School Journal (Marcli, 1018), vol. 18, pp. S05-2Z. 
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children could comprehend. They were, therefore, made aware o\ 
their rate of reading and kept graphic records of their individual 
standings in monthly regrouping tests. “A” readers were those 
whose rate was more than thirteen lines per minute. They were 
given the privilege of selecting their own material from the supple¬ 
mentary bookshelf for silent reading. This shelf was called "Story 
Row.” The books were arranged in groups according to content. 
A regular library system was used so that the teacher could ascer¬ 
tain at any time what each child was reading and what he had fin¬ 
ished. The quality of the silent reading could thus be revealed by 
conversation with the pupil. Children who had enjoyed a book 
were asked to review it for others who might care to read it. Fa 
vorite chapters were illustrated. Some cliildren chose informational 
material. They would recount interesting things wliich they had 
learned from their reading, and create a great demand for tlie book 
■which they had read. No more than two books could be used by a 
pupil at one time and stories had to be finished before another 
story book could be begun. 

"B” readers were those whose rate was more than nine lines per 
minute, but not more than thirteen. Pamphlets were provided for 
their supplementary reading. The material was easier and the con¬ 
tent quite suited to their comprehension. Otlierwise the system 
used for the "B ” readers was like that for the "A” groups. They 
had less time for supplementary reading as tlioy required more in¬ 
tensive work with the teacher. Their pamphlets were very popular 
and were often read by “A” readers. 

There was also a group called “C” readers whose rate was be¬ 
tween six and nine lines per minute, and another group of “D” 
readers who read even more slowly and got practically no meaning 
from the subject-matter. Their supplementary material consisted 
of separate stories. These they read with the teacher, alternating 
with her. They liked to have stories read to them. The teacher 
used her book. The group looked over her shoulder and kept tlie 
place, picking up the story and reading on when she stopped, until 
the end of a paragraph was reached. The meaning was tiicn dis¬ 
cussed and the reading continued. 

Each child in the class subscribed to a little nature magazine 
which was kept in the desks for reading during odd minutes. Sev¬ 
eral other magazines, an atlas, and a file containing good original 
stories by the children wore also at their disposal for this purpo.so. 

The regular reading instruction was the visible means by 'the 
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aid of Tvhich each pupil Loped to get into a group higher tlmn lus 


own by the next measurement. 

These groupings were based 
on rate and were not identical 
with those made for corrective 
teaching. The procedures just 
described, together with the in¬ 
tensive teaching in type lessons 
which follow, were jointly re¬ 
sponsible for improvements in 
reading rate and quality. This 
report would, therefore, be in¬ 
complete if detailed descriptions 
of methods used to secure the 
interest of the individual child 
were omitted. [Seven of the 
typo lessons relate to oral read¬ 
ing. They are omitted.] 

Type lesson S. Silent read¬ 
ing for the purpose of oral re¬ 
production and comprehension. 

Type lesson 4- Silent read¬ 
ing in search of a given phrase, 
answer, idea, or suggestion in 
the content of supplementary 
books, geography text, arith¬ 
metic text, and blackboard 
work. 

Type lesson 10. Word-study, 
with difficult words, for ready 
recognition, pronunciation, and 
comprehension. Word-building 
and word-structure studied. 

Results. Fig. 14 shows 
the results for November, 
December, and February in 
silent reading. The range 
of scores has not been re¬ 
duced. In fact it has been 





Rg. 14. SmEST BsAniXG Rkrrs of Foubth-Gr\de Pupna, showisg Effect of Cohbe c ti ve TkEAXMESr. 

iAJier Zirbes.) 
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increased, but the significant thing is that the low scores 
have been materially increased in most cases. The letters 
inside the small squares designate the different pupils. 
Pupil T has advanced from two lines a minute to eight lines 
a minute. Pupil R has gone from two lines to twelve lines. 
Pupil S has remained at ten lines. In Fig. 15 we have a 
graphical representation of one of the causes of this prog¬ 
ress; that is, the average amount of supplementary silent 
reading done during school hours. The increase in the 
amount is very significant. It shows what can be done 
when an effort is made. 
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Fio. 15. Avehaoe Ntnanim op Pages op Silekv Readimq pbb PopHi 

puniNG School Homia. Supplementahy Matbhial. (After Zirbee.) 

Summary for Type HI. When the scores of a class are 
widely distributed, individual instruction is required. Sev¬ 
eral illustrations of individual defects, the method of dealing 
with them, and the results have been given. One case of 
group instruction supplemented by individual instruction 
has been described. 

Type IV. Slow readers and poor in comprehension in pri¬ 
mary grades. The class record sheet of a second-grade class 
which was given the Courtis Silent Reading Test No. 3 is 
shown in Fig. 16. It is obvious that the pupils of this class 
both read very slowly and comprehend httle of what they 
read. 

The cause: over-emphasis on oral reading. The com¬ 
monest of all reasons for this situation, particularly when 
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found in the grades below the sixth, is that the teaehers 
have been placing chief stress upon oral reading. Where 
children are required to ^ve their attention mainly to the 
correct pronunciation of words, the correct enunciation of 
sounds, and the correct inflection of the voic'e in pa-ssing 


{xulaE oi CfltxipratMimloru 



Eiq. 16. Showing mn SconEa of a 2'A Class on tub Countia Silhnt 
Reading Test No, 2. {Typo JV-) 

over the several punctuation marks, not much growth in the 
power to comprehend the meaning in tlie printed page can 
be expected. Where the children study their reading les-soii 
with the point of view of being able to respond in this way, 
they fasten upon tliemselves the habit of watching for words 
whose pronunciation they are not sure of, or they form tlio 
habit of reproducing the sounds of syllables, Ihus estab- 
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listing llie practice of moving the lips and other speech 
organs when reading silently. Frequently both tliese habits 
fix themselves upon children whose reading is judged mainly 
by the daily oral performance. When either or both habits 
become fixed, a real struggle is required to break them. Un¬ 
less they are broken, however, the child suffers a severe 
handicap the rest of his reading life. Many men and women 
of mature years are still paying the price of those habits 
fixed in youth. They are able to read but little faster si¬ 
lently tlian they can pronounce the words orally, because 
their speech organs make all the motions of the successive 
words as the reading proceeds, 

An illustration of the result of over-emphasis upon oral 
reading. Judd ‘ ^ves the case of a girl in high school which 
illustrates the result of over-emphasis upon oral reading. 
The girl was getting on well in her school work, but “found 
it exceedingly difficult to keep up with her classes in home 
assignments.” Reports from her various instructors brought 
out the following statements: 

She is a very satisfactory student in French because she thinks 
clearly, studies thoroughly, and pronounces easily and correctly. 
The only drawback to her wort is a lack of confidence in herself, 
which leads her to lose her head occasionally and feel that she 
knows much less than is the case. In English she is on appreciative 
and careful student, a little slow at times in getting a grasp of 
things. She has certainly no serious weakness up to this point and 
frequently offers hints of superior work. In mathematics she is in 
the better section and stands eighth among eighty-five students. 
In general science her work has been very satisfactory and her 
grades are high. 

This girl is like many another student who is getting on all right 
so far as the school is concerned, but is doing it at great expenditure 
of effort. 

She was tested with a series of passages both in oral and silent 

' Judd, C. H., Reading: Its Nature and Development. Supplementary 
Educational Monographs (University of Chicago Press), p. 161. 
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reading, ... The figures show that in general the rates of silent 
and oral reading are very much alike. ... 

There were marked tendencies to whisper all material read. She 
was much surprised when told not to do this and was sure .she would 
not understand what she read because, as she said, she understood 
what she read only when she “heard” the words. 



Fio. 17. Showing the Scoheb of a Sixth-Gbadb Class on ihb 
CoDKTis Silent Rbadino I'est No. 2. {Tyj/e V,) 

The Remedy. The remedy for this type of situation, 
particularly below the sixth grade, is to place more emphasis 
upon silent reading. In doing this the suggestions given on 
page 59 will be helpful. 

Type V. Slow readers with a satisfactory index of com¬ 
prehension. Fig. 17 shows the record of a sixth-grade class 
which is deficient in rate of work. The median number of 
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words per minute is fifteen less than the standard and tb 
median number of the last question is also fifteen below thtf 
standard. The index of comprehension is only fom points 
below standard. These facts show that the pupils of this 
class read slowly and particularly answer questions slowly. 
However, they ai'e careful readers as is shown by the index 
of comprehension. They need training in more rapid read¬ 
ing. The suggestions given on pages 66 and 68, apply to this 
type also. 

VI. CoHBECTiNG Defects in Oral Readinq 

The record of the scores of a class in the case of Gray’s 
Oral Reading Test is not so helpful to a teacher as the 
records of the reading of individual pupils. This shows the 
types of errors which they made and a knowledge of them 
frequently will suggest the appropriate remedy. 

An illustration of individual instruction in oral reading. 
The fourth-grade teacher from whose report we quoted on 
pages 79to 81 also dealt with oral reading. The “group” 
instruction described on page 80 applied in part to oral read¬ 
ing. This was supplemented by seven types of individual 
instruction. 

Type lesson 1. All look at the first phrase, looking up when tliey 
reach a comma or a period. When the entire group is looking at the 
teacher she nods and they repeat the phrase. She watches individ¬ 
uals to find their difficulties, but does not interrupt. When they 
have Said all but the last word of the plirase they again look down, 
silently getting the next phrase and looking up, holding tlie phrase 
in mind nntQ all are ready. Again Hie teacher nods and the group 
gives the phrase orally, looking down at the last word and con. 
turning this procedure to the end of the paragraph or section. 

The intensive study calculated to improve poor readers can be 
made to yield a double return, if, instead of selecting bard words 
and subjecting them to analytic study, the unit is the plwaso or 
group of words which expresses an idea. Instead of working at a 
difficult word, the phrase in which it appears is studied until mas- 
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tered. Instead of working with one child at a time and giving each 
child only a few minutes of actual oral reading, four or five of those 
who have similar ability are grouped together, while other grotips 
of poor readers follow silently. Third-grade material or very simple 
fourth-grade material is used for tliis purpose. 

■While other pupils are being tested, the ones who have had Typo 
1 answer mentally or in writing blackboard questions concerning 
the material of their lesson. Occasionally duplicated .sheets con¬ 
taining uncompleted sentences or a story are used instead, th', 
children filling in the blanks mentally or in writing. 

Type lesson !2. Eye training aaid focus. Field of vision enlarged 
to include several words rather Rian one. First, by having the 
book far enough from the eyes. Secondly, V>y elimuiating the u.so 
of a finger or other piace-kceping device. Thirdly, by work with 
flash cards, flashing pluases, trying to get a phrase at one flash, and 
counting the number of flaslics needed for each phrase. These 
phrases were cut from current printed matter and mountctl on 
small cards. Written sentences directing children to perfonn cer¬ 
tain activities were also used as flash material. The one who first 
read the direction carried it out. Tlic one who had three such op¬ 
portunities in succession was given a sheet with similar work for 
silent reading and could return to the group when fiui.shed. 

Type lesson 6. Differentiation for pupils who eoufuae similar 
words or miscall syllables, gue.s3 at words, or omit einlings. Li.sta 
like the following form the basis of .such work. Lists are compiled 
from actual mistakes made by children: 


that 

woman 

beautifully 

swimming 

when 

every 

prettiest 

board 

what 

never 

prettily 

close 

then 

even 

probably 

chose 

how 

ever 

lovingly 

lying 

who 

very 

comjjnnions 

buying 

their 

these 

understand 

tired 

there 

those 

understood 

tried 

than 

now 

laughingly 

certain 

women 

know 

quietly 

curtain 

man 

beautiful 

left 

felt 


Type lesson 6. Lessons in accuracy for those who make errors, 
substitutions, and omissions; reading a page orally and counting 
errors, or reading until they make an error to see how many lines 
they can read perfectly. 
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Type lesson 7. Breathing exercises. Children taught to breathe 
rhythpiically at ends of phrases or clauses instead of breaking the 
smoothness of oral reading. Practice in breath control is thus re¬ 
lated to the problem of meaning and interpretation. Abdominal 
breathing taught. 

Type lesson 8. Articulation exercises for mumblers, or those with 
other bad speech habits. 

Type lesson 9. Voice work and expression. Unpleasant voice 
quality and monotony corrected by special practice and training. 
Children are taught to vary meaning by change of stress and to 
show relative importance of ideas similarly. Punctuation is studied 
for the same purpose. 

The Results. For oral reading very striking results were 
obtained. They are shown graphically in Fig. 18. The in¬ 
crease in the closeness of the grouping of the members of the 
class is significant as well as the progress made by the indi¬ 
vidual pupils. 

The base line represents lines read per minute. The lettered 
blocks represent individuals. The group divisions are shown by 
vertical lines. Thus pupil O was in Group “U” and read five lines 
per minute in November, moved to Group “C” in December, and 
was reading nine lines per minute. In January he read twelve lines 
per minute and was in Group “B.” In February he read tliirteen 
lines per minute, but did not get into Group “A” until March. 
. . . The reading rate is an average of from tliree to five trials on 
as many selections of unstudied material from the Horace Mann 
Reader. No rate of measurement was made in April, as other 
reading tests were conducted.* 

Interpretation of scores in ungraded schools. In rural 
schools or other ungraded schools classes are frequently so 
small that it is not wise to use the median or class scores. 
The interpretation is largely a matter of comparing the 
scores of individual pupils with the standards. In doing this 
certain facts should be kept in mind. First, the standards 
are median scores. For example, the standards for the fifth 

* Elementary School Journal, vol. 18, p. 612. 
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grade are llie median scores of several thousand fifth-grade 
pupils. Thus half of these pupils had scores greater than the 
standard scores and half of them had scores less than the 
standards. Second, pupils of the same grade differ widely 
in ability, and when the class scores are up to standard, half 
of the class will be above standard and half will be below. 
Third, in schools where only a few pupils belong to a grade, 
it may be that all are pupils of little natural ability, and 
hence should not be expected to have scores up to standard. 
On the other hand, it may be that they have a high degree 
of natural ability and should have scores distinctly above 
standard. 

This makes the interpretation of the scores of individual 
pupils or of small groups of pupils difficult and somewhat 
uncertain. However, it is safe to say that when a pupil is 
distinctly below standard in rate or comprehension of silent 
reading, or both, his case should be carefully studied by the 
teacher. Much of what has been said concerning the causes 
of class wealmesses and the correctives for them also applies 
to individual pupils. Some pupils will be found to be high 
in rate, but low in compreheusion (the rapid, careless reader; 
see pages 51 to 58 ); others will be low in rate, but relatively 
high in comprehension (the slow, plodding, but careful 
reader; see pages 65 to 68); still others will be low in both 
rate and comprehension (the slow, careless reader or one 
who has not learned to read; see pages 73 to 79). 

Some pupils will be found who are distinctly above stand¬ 
ard in both rate and comprehension. In such cases the 
teacher’s problem is different. These have made satisfactory 
progress in silent reading under the instmetion which they 
have been receiving and thus they require no special atten¬ 
tion. The only case in which a modification of the instruc¬ 
tion should be made is when a pupil who is above standard 
in silent reading is not doing satisfactory work in arithmetic^ 
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spelling, or some other subject. Then he should spend less 
time reading and more upon the subject in which he is weak. 

The rural teacher’s opportunily for diagnosis and correc¬ 
tive instruction. When a teacher has a small number of 
pupils, he has an unusual opportunity for diagnosing his 
pupils and applying the required corrective instruction. 
Each pupil can be studied until his strong points and his 
weaknesses arc known. Upon the basis of this information 
the teacher can easily apply the correctives because the in¬ 
struction is largely individual anyway. The teacher who has 
twenty-five or more pupils in one class has much less oppor¬ 
tunity to deal with individual pupils. When the teacher 
knows the scores of the pupils of his class on standardized 
tests, each pupil can be given that kind of instruction 
which he needs and under which he will make the gi’eatest 
progress of which he is capable. 

The use of standardized tests does not require a large 
amount of time. To teachers who may be interested in such 
diagnostic and remedial work this comment by the autlior 
of the above report is significant. (See pp. 70 and 80.) 

This study was not conducted by a specialist, but by a grado 
teacher interested in the advancement of the class through mctlKKla 
which reach the individual members. No lime was taken from 
other studies. In fact a similar experiment in individual inaLruction 
was simultaneously carried on in spelling, aritlmictic, and i)cnTnan- 
ship. The results were tested and arc evidence that no one subject 
was over-stressed. The time economy, resulting from aeienlilic 
procedure, also made possible a fullness and breadth of teacdiitig 
usually thought incompatible with standardization and educa¬ 
tional measurement.^ 

Summary. The ideas presented in this chapter may be 
summarized under three heads: 

(l) Service of standardized tests to the teacher. By far the 

1 Elementary School Journal (March, 1018), p. 522. 
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largest service of standardized tests in reading is being 
rendered to the teacher. Not only are they enabling the 
teacher to check up his conception of what can justly be 
expected of children, but they are indelibly impressing 
upon his mind the absolute need for recognizing the indi¬ 
vidual differences among his pupils in respect to each 
problem of learning, and for studying the reading needs of 
his pupils in order to plan the instruction most wisely. In 
this chapter we have considered the meaning of certain 
types of class records, how to secure additional information 
concerning the reading abilities of pupils and the general 
correctives which should be applied to improve the stand¬ 
ing of such classes. For certain cases we have given illus¬ 
trations of the detailed diagnosis of pupils, the correctives 
which were applied, and the results which were obtained. 

The distinction between silent reading and oral reading 
has been emphasized. The teacher should bear in mind that 
a pupil may read well orally from his reader, but may be 
doing poorly in geography or in the problems of arithmetic 
because he has not learned to read silently. These content 
subjects depend upon reading, but not upon the sort of 
oral word-pronouncing which still too largely characterizes 
our reading periods. Such a child needs a different sort 
of reading. He would be found to stand low, probably, in 
vocabulary; probably low in quality of silent reading. If 
the teacher has before him a chart upon which is recorded 
the standing of this child in the various aspects of reading, 
he will no longer assign for his study the next page or two 
in tlie Reader, He needs the sort of reading which widens 
his vocabulary more rapidly and centers his thought upon 
meaning instead of upon words. 

As an illustration' of the aid of reading tests in such 

* Uhl, W. L,, “The Use of the Results of Reading Tests as a Basis fol 
Planning Remedial Work”; in Elementary School Journal (December, 
1816), vol. 17, no. 4. 
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diagnosis, the case of the Training School at Oshkosh, Wis¬ 
consin, may be cited. Dming a summer term of only six 
weeks, pupils, by use of the Kansas Silent Heading Tests, 
the Gray Oral Test, and the Gray Silent Reading Tests, had 
their difficulties localized. Instruction was then given upon 
the points revealed to be needing attention. Twenty out of 
one hundred and five children were given different instruc¬ 
tion from that given the class as a whole. Surprisingly 
greater results were obtained in the case of those children 
whose instruction was specifically adapted to their diffi¬ 
culties. 

(S) Service of standardized tests to the rural teacher. Stand¬ 
ardized tests render a peculiar service to rural teachers by 
setting standards for them. A teacher who works in isola¬ 
tion from other teachers needs to know how her pupils com¬ 
pare with pupils in other schools. Since standardized tests 
have been widely used, they fiunish a means by which any 
teacher can easily ascertain how her pupils stand in com¬ 
parison with the established standards. 

{S) Service of standardized tests to the child. Since the begin¬ 
ning of schools children have been sent to school to be 
taught. That being the case, they wait to be told what to 
do, and there is the end of their responsibility. When the 
end of the month comes they look to tlieir report card for 
a measure of their success in doing what they have been 
told. 

A function of standardized tests, by which the child can 
measure his own achievements about as successfully as the 
teacher can, is that they bring the child into partnership 
with the teacher in directing the whole educative process. 
If the child discovers by actual trial that he has only three 
fourths as large a vocabulary as children of his grade the 
country over, or that he reads only three fourths as fast, 
he can be depended upon better to cooperate in overcom- 
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ing the fault than when he is simply given a card every 
month with 70 assigned to his reading. Particularly is this 
true if he feels that at the end of a given period he can take 
his own measure again to ascertain his gain. Children 
should be enlisted with the teacher in the effort to select 
the most needful sorts of materials for their study. Where 
one child needs problem-solving, another needs a story, 
while still another needs something else than reading of 
any kind. 

Service of standardized tests to the superintendent. Al¬ 
though tliis book is written primarily for teachers, it will not 
be out of place to call attention to tlie usefulness of stand¬ 
ardized tests to the superintendent or supervisor. From the 
importance of reading in the general efBciency of all school 
work we may assume that the superintendent is vitally 
interested in making the instruction in reading most effec¬ 
tive. What can reading tests reveal to him? 

First, they can satisfy him and his teachers of the general 
status of reading in his district. It is easy for any superin¬ 
tendent to carry conviction among his teachers that the 
results iu reading are not satisfactory in his district if he can 
show that among a group of a dozen or more neighboring 
cities bis district stands low. The extent to which it stands 
low becomes a measure of the renewed earnestness needed in 
attacking the problem of improvement. 

It is difficult for one to carry in mind a fixed standard of 
achievement. One gradually thinks more and more in terms 
of what those around him are achieving. It would have been 
quite impossible, for example, to convince the superintend¬ 
ent and teachers of tlie Anglo-Korean school at Songdo,* 
without a standardized test, that the children in their fifth 

' Wasson, Alfred W , “ Report of an Experiment in the Use of the Kansas 
Silent Reading Tests with Korean students”; in Educational Adminialra- 
tion and Supervision, vol. 3, p. 98. 
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grade could do, on the average, reading work valued at only 
3.8 units, while American children, who had been in school 
only the same number of years, could score 13.2 units, or 
that their sixth grade could accomplish only as much as the 
American third grade. It meant much to that school for its 
superintendent and teachers to be able to measure their 
school by the American standards. 

Reveal wrong emphasis in teaching. Differences in the 
reading work done in the several buildings within a city may 
be as striking as differences among cities. In a certain Mid¬ 
dle-Western town a forceful principal of one of the ward 
buildings has dominated the work of the building for a good 
many years. The reading of the building was his particular 
pride. When tested for silent reading ability his children 
scored in every grade but little more than half what the 
children in another building scored where the work was re¬ 
puted to be “much less thorough.” These results were made 
the basis of deliberations among the teachers as to the legiti¬ 
mate outcomes of reading, with the result that, without 
diminishing any one’s zeal, the emphasis was transferred 
from oral word-pronoimcing to silent thought-getting in the 
building where this strong principal dominates the work so 
effectually. 


QUESTIONS AND TOPICS FOR STUDY 

1. What ate the chief methods by which adults add new words to their 
vocabularies? Are more new words learned from the context in which 
they appear, or from the dictionary? Wlmt can you say concerning 
the best way to increase the vocabulary of children? 

2. What are some of the other factors besides vocabulary involved in 
silent reading? In what grades is vocabulary the most important fac¬ 
tor? Make some suggestions for guaranteeing the intimate association 
of tlie mental concept which a word symbolizes, and the word itself 
when it is encountered in word drills, 

8. What is the significance of rate in reading? Is there any truth in the 
rather common belief that one who reads slowly "gets more out of 
what he reads” ? If you do not know the answer, can you devise some 
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way to test it out In your class? Compare your own silent reading 
rate witli that of some equally wclkducated friends. 

4. What are the chief dangers involved in having much oral reading in 
the lower grades? Can these dangers be safeguarded? What types of 
reading matter do you now rend orally outside the schoolroom? Are 
these fte types which your pupils are asked to read orally? 

5 . What are the circumstances under which you last read aloud? Do 
your pupils liave the same incentives for reading clearly and inter¬ 
estingly that you had on that occasion? 

6. Whatare some of the things you do to assist your pupils in developing 
ability to comprehend the meaning of the printed page? Do you know 
of faulty habits which some of them have which prevent Lhcir cenlcr- 
ing attention upon the meaning? Do you know which pupils read 
with accuracy? Which with rapidity? 

7. How long does it take you to become familiar with the reading diffi¬ 
culties of eacli child when you receive a new class of, say, thirty chil¬ 
dren? Would you consider it economical if some tests were available 
by means of which you could discover these difficulties as well as 
others the first day and thus prepare a chart of each child's instruc¬ 
tional needs? How long at the beginning of a term could you afford 
to spend in making such a diagnosis? 

8. Think of the last examination you gave in reading, Did it test satis’ 
factorily what you are striving to tench in rending? 



CHAPTER IV 

THE MEASUREMENT OP ABILITY IN THE OPERATIONS 
OF ARITHMETIC 

How arithmetical ability is measured. The plan of meas¬ 
uring the ability of pupils to do the operations of arithmetic 
is to have them do a set of examples' under specified condi¬ 
tions, In order that the scores may have a definite meaning, 
the test is limited to one type of example in one operation, 
as subtraction or multiplication or at most to a group of 
closely related types. The necessity for determining tlie 
value of the different examples in the test can be elim¬ 
inated by constructing the examples so that they con¬ 
tain the same number of combinations; that is, in addition 
having each example involve twenty additions. The rate at 
which the pupil performs the operations is measured by 
timing the test as was done in the measurement of the ability 
to read silently. In the following pages we will descrite two 
tests which have been devised to measure the ability of 
pupils to do the operations of arithmetic. 

I. CoiJBTis Standard RESEABcn Tests, Series B 

Description of tests. The Standard Research Tests, Series 
B, or, as they are commonly called, the Comtis Arithmetic 
Tests, have been more widely used than any other instru¬ 
ment for measuring arithmetical abilities, and as a result 
we have better comparative standards for their use, The 

‘ The word "problem” is used by some writers to designotc boUi “ex¬ 
ample” and “problem." In this book tlie word "example" will be used 
to designate exercises which explicitly call for certain ivritlimclical oper¬ 
ations. The word “problem” will designate only those exercises which 
require the pupil to determine first what operations are to bo performed. 
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series consists of four tests, printed on four consecutive 
pages. They are suitable for a general survey of the abilities 
of pupils to perform the operations with integers. They are 
used in Grades four to eight. 


Test No. 1. Addition 

The twenty-four examples of this test have been con¬ 
structed so that all have the same form, three columns 
of nine figures each. The following are samples. Time 
allowed, 8 minutes. 


927 

297 

136 

486 

384 

170 

379 

925 

340 

765 

477 

783 

756 

473 

988 

624 

881 

097 

837 

983 

386 

140 

266 

200 

924 

316 

353 

812 

079 

SCO 

110 

061 

904 

466 

241 

851 

854 

794 

547 

856 

796 

636 

965 

177 

192 

834 

860 

323 

344 

124 

439 

607 

733 

229 


In giving the test the pupils are directed as follows: 

You will be given eight minutes to find the answers to as many 
of these addition examples as possible. Write the answers on this 
paper directly underneath the examples. You are not expected to 
be able to do them all. You will be marked for both speed and ac¬ 
curacy, but it is more important to have your answers right than 
to try a great many examples. 


Test No. Svbtraction 

This teat consists of twenty-four examples, each involving 
the same number of subtractions. The following are sam¬ 
ples. Time allowed, 4 minutes. 

107795491 76088824 91500063 87939983 

77197029 6740C394 199015G3 72207316 
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Test No. 3. Multi'plicaiion 

This test consists of twenty-font examples of this type. 
Time allowed, 6 minutes. 

8246 3507 6780 2048 9637 

20 _ 'n _M 40 02 

Test No. J/.. Division 

This test consists of twenty-four examples of this tyi>e, 
Time allowed, 8 minutes. 

25 )0775 04 )85352 87 )0000 80 )80000 

73 )58705 40 )31409 08 )43520 5 2)44252 

Each of the examples of a test calls for the same number of 
operations imder approximately the same conditions. This 
makes the examples of each lest approximately equal in 
difficulty. Any example of the addition test, say the seventh, 
is just as difficult as any other, say the second. Thus, tlie 
tests consist of twenty-four equal units, just as a yardstick 
consists of thirty-six equal units (inches). The measure of 
a pupil’s ability is represented by the distance he advances 
along the scale in the given time; that is, by the number of 
examples done and by the per cent of these examples which 
have been done correctly. 

Since an example of one of these tests is defined as so many 
operations xmder certain conditions, it is possible to con¬ 
struct other tests equal in difficulty. Four form.s have been 
constructed. This makes it possible to use a different form 
when the tests are given a second time. 

Giving the tests. The general directions for giving read¬ 
ing tests also apply in the case of arithmetic. (See page ®5.) 
Detailed directions accompany these tests. Since the same 
tests are given in all grades, a group of pupils belonging to 
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two or more grades can be tested together. It is only neces¬ 
sary to sort the papers according to classes when recording 
scores. If it is not convenient or desirable to give the four 
tests on one day, the teat papers may be collected and re¬ 
turned the next. 

Marking the papers. In marking the test papers, which is 
done by the use of a printed answer card that is run along 
across the page, no credit is given for examples partly right 
or for examples partly completed. This simple plan of mark¬ 
ing the papers insures imiformity and accuracy. A pupil’s 
score is the number of examples attempted and the number 
tight. The number of examples attempted is a measure of 
the pupil’s rate of work. By dividing the number right by the 
number attempted, the per cent of examples correct may be 
obtained. This is a measure of the qualiiy or cwcuracy of his 
work. Thus, the two “dimensions” of the ability to do the 
operations of arithmetic are rate and accuracy. 

Recording the scores of a class. For recording the scores 
of a class a record sheet of the form shown in Fig. 19 is used. 
This figure contains merely the blank for addition, but the 
forms for the other three tests of the series are identical with 
it. Detailed instructions for recording scores are printed on 
the record sheet. The large figures at the top of the sheet 
refer to the number of examples attempted and the small 
figures within the squares refer to the number of examples 
done correctly. The sheet is arranged so that the per cent 
of examples done correctly is computed automatically and 
the distribution of the scores according to both rate and 
accuracy is obtained at the same time. The scores of a 
seventh-grade class are shown in Fig. 19. The numbers 
written in certain of the squares represent the number of 
pupils whose scores fell within these divisions of the record 
sheet. The distribution according to rale is found at the 
bottom of the record sheet and is to be read thus: Three 
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pupils attempted only six examples, two pupils attempted 
only seven examples, five pupils attempted only eight ex¬ 
amples, etc. The distribution according to accuracy is found 
at the right-hand side of the sheet and is to be read thus: 
The per cent of examples done correctly by two pupils was 
less than fifty per cent, for five pupils it was between fifty 
per cent and sixty per cent, for five other pupils it was be¬ 
tween sixty per cent and seventy per cent, etc. These two 
distributions, the one according to the jrer cent of examples 
done correctly and the other according to the number of the 
examples attempted, describe the ability of the pupils of 
this class to do the examples of the addition test. 

Calculating the median score of a class. The central tend¬ 
ency (median) of the distribution of scores in the case of 
silent reading was found by arranging the test papers in 
order and counting up to the middle paper. The score on 
this paper was the median score. (See page 28.) This is not 
the best method to use here. For calculating the median, 
Courtis gives explicit directions in Polder D which is de¬ 
signed to accompany this series of tests. We give here gen- 
crnl directions for finding tlie median so that they can be 
conveniently referred to. 

' . median is the mid-measure of a distribution. In the 

case or o distribution having an odd number of scores it is 
the value of the middle score. If there is an even number of 
scores it is halfway between the two middle scores. 

Table XII gives a group of scores in the form of a distribu¬ 
tion. The column labeled “Score” gives the scores arranged 
in order of magnitude. The column headed “Frequency” 
tells how many scores there are of each magnitude, or how 
frequently each score occurs. In this table there are two 
scores of 13, two scores of 12, five scores of 11, etc. The total 
number of scores is 45. The twenty-third score is the mid¬ 
dle one, but it is not possible to identify its value di- 



THE OPERATIONS OP ARITHMETIC 


103 


Table XH. Showing a Typical Distribution on Scohes 
IN Number op Examples attempted 


Score FreQumcy K 

14 1 

13 2 

12 2 

H 6 

10 0 

0 7 

8 8 

7 B 

6 S 

6 2 

4 1 

3 

2 _ 

Total. 45 

Approximate median. B.O 

Correction. 8 

True median. 0,0 


* Tlie frequency is the number of pupils making tbo scorn indicated, Tlie scalo oonslsb 
of the scores arranged in order. 

rectly. It is clearly one of the seven scores given os 9, 
because counting from the lower end of the distribution, 
1 and 2 are 3, and 3 are 6, and 5 are 11, and 8 are 19, and 
7 are 26, which is beyond the middle of the distribution. 
Therefore the approximate value of the median of this dia^ 
tribution is 9,0, which is the interval which contains the 
true median. 

Rule for finding median. (1) Find the half sum of the 
distribution. In case there is an even number of scores, 
there is no middle score. In such a cose tlie average of the 
two most central scores may be taken, although for practical 
purposes it will be satisfactory to take the lesser of the two 
middle scores. By doing this the calculation of the median is 
made simpler. Thus, if a distribution contains forty-one 
scores, the middle score is the twenty-first score; if it con- 
tains forty scores, the twentieth score may be taken as the 
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middle scored The number of the middle score is obtained 
by dividing the total number of scores by two. This quo¬ 
tient, expressed as the nearest integer, is ealled the “half 
sura.” When using a particular test the directions which 
accompany that test should be followed, because the medi¬ 
ans used for standards have been obtained by following the 
accompanying directions. 

(2) To determine the approximate median it is simply 
necessary to locate the interval of the distribution in which 
the median falls. To locate the interval in which the median 
falls, begin at the lower end of the distribution and add to¬ 
gether the frequencies until the addition of the next one will 
make a sum greater than the number of the median score, 
or half of the total of the frequencies. This sum of the fre¬ 
quencies is called the “partial sum.” The median score is 
in the next interval, and the approximate median is the 
value of that interval. 

(3) To calculate the amount to be added to the approxi¬ 
mate median to make the true median, proceed as follows: 
(1) Subtract the partial sum of the frequencies from the half 
sum. The partial sum is found in determining the approxi¬ 
mate median. (2) Divide this difference by the number of 
scores which are included in the interval in which the true 
median falls. Add this quotient to the approximate median. 

' There is a difference of practice on this point. The directions which 
accompany the Monroe Standardized Silent Beading Teats read as follows: 
“The median score is the score on the middle paper in the pile of papers 
arranged according to size of scores. If there are thirty-Qve papers, the 
median score is the score on the eighteenth paper. If tliere are thirty-six 
papers, the median score is halfway between the score on the eighteenth 
paper and the score on the nineteentli paper." 

The directions whicli accompany the Courtis Standard Besearch Testa 
m Arithmetic, Series B, read as follows: “If there are thirty-seven clid- 
dren in the class, the nineteenth score in order of magnitude would be the 
median score; for there would be eighteen scores larger and eighteen smaller. 
If there wore thirty-six children in the class, the eighteenth score would be 
taken as representing the nearest approximation to the middle measure." 
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If the width of the interval is more than one unit, tlie quo¬ 
tient must be multiplied by the number of units the interval 
contains. It is well to carry tire quotient to two decimal 
places, but in writing the median it should be expressed only 
to the nearest tenth.^ 

The rule applied. In Table XII the half sum is 23. The 
approximate median is 9.0. The partial sum being 19, four 
of the seven scores in the O-interval are required in order 
to reach the mid-point of the distribution. Four divided by 
7 is .6, which, added to 9.0, gives 9.6 the true median. 

Special cases. Although the rule given applies to all cases, 
there are a few special cases which sometimes give trouble. 
In Table XIII we show three special cases which may arise 
in using Series B. Case A is where the partial sum (L'l) is 
also the half sum (13). The approximate median is in the 
next interval (9). Since the difference between the partial 
sum and the half sum is zero, there is no correction and the 
true median is also 9.0. Case B is where the median falls 
in the first interval (0 to 49). It is only necessary to re¬ 
member that the width of this interval is 50. Case C is 
where the median falls in the 100-interval. The width is 
zero. Hence the correction is zero. 

Efficiency. Courtis has defined a measure of “efficiency.” 
He says: 

The word “efficiency” as applied to education has, only too 
frequently, but little meaning. As used in connection with the 
Courtis Tests, however, it has a very definite meaning os soon as 
the following definition has been accepted; The efficiency oj any 
teaching process which has a measurable product is the per cent oJ 
the total product that measures up to the standard for the grade. 

For each test find the sum of all the frequencies equal to or exceed¬ 
ing the standard. Multiply this sum by 100 and divide by the total 
number of scores. The result will be the efficiency for that test. 

‘ See King, "W. I, The Elements of Statistical Method, pp. 129-30; and 
Thorndike, E. L., Mental and Social Measurements, p. C4. 
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In Fig. 19 lines have been drawn to mark off those scores 
which are up to standard in both rate (11) and accm'acy 
(100). There are three such scores. The efficiency of this 
class thus is 3004-39, or 7.7. However, many users of 
Series B do not believe the efficiency score has an important 
aignificance and it is not generally used. 

Tabi® "yTTr. Showenq Three Special Cases m calculatinq 
THE Median which arise in Using Couhtis’s Standard Re- 


BEAHOH Tests, Series B 
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Fi'iquency Soals 

Prequtnen Seale 

Pfeguenop 
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,, 
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1 
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15 
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4 
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,, 

9 

e 
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14 

0- 40 

.. 

a 

i 
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Total. 




0 
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6 


Approximate median 0.0 

Approximate median 100 




,..x 43.0 









Total... 


True median* •*. 


True median. 

...100 


Approximate Diedlao 9<0 
Oorreotion.0 


Xruo median. •< fox • 0>0 


Oorreotion.0 

Xruomedian.•<fox. 0.0 


standard median scores. In Table XIV there are given 
three standard scores, (l) General median scores based 
upon distributions of “many thousands of individual scores 
in tests given in May or June, 1915-16. The distribution 
for each grade was made up of approximately equal numbers 
of classes from large-city schools and from small-city and 
country schools.” (2) The standards proposed by Courtis 
after three years’ use of these tests. (3) Boston standard 
median scores after the tests had been used for three years. 
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These standards are given in terms of rate and accuracy, 
which is the best form. However, for certain purposes it 
may be desirable to have them in terms of “number at¬ 
tempted” and “number right.” The number of examples 
right can be found by multiplying the number of “examples 
attempted” or the rate by the accuracy. 

With reference to the standards which he has proposed 
Courtis says: 

The speeds [rates] set as standard are approximately the average 
speeds [rates] at which the children of the dift'erent grades have 
been found to work when tested at the end of the year, when for 
any one grade a random selection of five thousand scores from 
children in schools of all ts^pes and kinds are used as a basis of 
judgment. 

Standard accuracy is perfect work, one hundred per cent. This 
is a tentative standard only, as there is available very little infor¬ 
mation in regard to the factors that determine accuracy and the 
effects of more efficient training. 

At present in addition and multiplication it is only very excep¬ 
tional work in which the median rises above eighty per cent accu¬ 
racy, while in subtraction and division the limiting level is ninety 
per cent. 

Standard speeds [rates] are not likely to change greatly. Stand¬ 
ard accuracy is surely destined to approach much more nearly one 
hundred per cent than present work would indicate. 

Standard scores are not only goals to bo reached; they arc limit.s 
not to be exceeded. It seems a.s foolish to overtrain a child ns it is 
to undertrain him. All direct drill work should, in the judgment of 
the writer, be discontinued once the individual has reached stand¬ 
ard levels. If his abilities develop further through incidental train¬ 
ing, well and good, but the superintendent who, by repeated raising 
of standards, forces teachers and pupils to spend each year a larger 
percentage of time and effort upon the mere mechanical skills, 
makes as serious a mistake as the superintendent who is too lax in 
his standards.’- 

’ Courtis, S. A., Third, Fourth, and Fifth Annual Accountings, 1913-18 
(Department of Cooperative Eesearch, Detroit), p. 40 . 
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Table XIV. Standabd Median Scokbb, Codetis’s Standard 
Research Tests, Series B 


Grade 

Addition 

Sttbtraction 

MuKiplioaiion ^ 

DiviHon 

1 

Accuracy 

1 

Accuracy 

1 

Accuracy 

1 

Accuracy 

IV. General. 

7.4 

04 

7.4 

80 

0.2 

87 

4.0 

67 


6 

100 

7 

100 

0 

100 

4 

100 

Boetou.. 

8 

70 

7 

60 

6 

GO 

4 

60 

V. General. 

8,0 

70 

9.0 

83 

7.6 

75 

0.1 

77 


8 

100 

0 

100 

8 

100 

0 

100 

Boetou. 

9 

70 

0 

80 

7 

70 

6 

70 

VI. General..... 

9.8 

73 

10.3 

86 

0.1 

78 

8 2 

87 

Oouxtia. 

10 

100 

11 

lOO 

0 

100 

8 

100 

Boaton ., • •. 

10 

70 

10 

00 

9 

80 

8 

80 

Til. General. 

10.9 

76 

n.o 

60 

10.2 

BO 

0.8 

00 

Courtis. 

11 

100 

12 

100 

10 

lOO 

10 

100 

Boston.. 

11 

80 

11 

00 

10 

80 

10 

00 

Vni. General. 

11.0 

78 

12.9 

87 

11.5 

81 

10.7 

01 

Courtis..... 

12 

100 

13 

100 


300 ! 

11 

100 

Boetou. 

12 

80 

12 

00 ; 

11 

80 

11 

so 


Comparisons of class scores with the standards given in 
Table XIV or any others are valid only when the tests have 
been given under standard conditions. Slight changes in the 
method of giving the tests may affect the scores as much as 
the difference in the standards from one grade to another. 

The interpretation of scores. The standards for Series B 
are to be used for the interpretation of individual and class 
scores in much the same way as the standards for the read¬ 
ing tests. The form of the class record sheet is convenient 
for interpreting the scores of the class. If one will draw a 
vertical line to represent the standard rate and a horizontal 
line to represent the standard accuracy for the grade, one 
can tell at a glance what the condition of the class is. See 
Pig. 31, page 130. 

Graphical representation of the scores of a school. In Fig. 
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30 there is shown a scheme devised by Courtis for the 
graphical representation of the median scores of a city or 
school building. The position of the standards is shown by 
the circles along the dotted-line curve. The position of the 
median scores of a city is shown by the X’s through which 
the solid-line curve passes. This is a very effective means 
for showing the condition within a city or school. The figure 
makes it very clear that the median scores for number of 
examples attempted are conspicuously below standard. The 
position of the first X which represents the fourth-grade 
scores is below and to the left of the fourth-grade circle. 
This means that the fourth-grade scores arc below standard. 
The fiftli grade shows an increase in accuracy but the pupils 
do not work more rapidly than those in the fourth grade. 
From the fifth grade to the sixth and from the sixth grade to 
the seventh growth is shown, principally in accuracy. Por 
number of examples attempted the seventh grade is below 
the fifth-grade standards. The eighth grade shows an in¬ 
crease in rate of work but a marked decrease in accuracy. 

II. Monhoe’s Diagnostic Tests 

Arithmetical abilities distinct. A few years ago Stone^ 
investigated the nature of ability in arithmetic and con¬ 
cluded that it was made up of a number of specific abilities. 
His conclusions have been corroborated by a number of 
other investigations,** and it is now reasonably certain that 

* Stone, C. W., Arithmetical AbiKliet and Soma Factors Determining 
Them. (Teachers College Contributions to Education, no. 10, 1008.) 

“ Kallom, Arthur W., Determining the Achievement of Pnpils in Addition 
of Fraolions, (School Document, no. 3, 1010. Boston Public Schools.) 

Recently an investigation was made, under the direction of the writer, of 
the nature of the ability to place the decimal point in a quotient. This 
investigation showed that a number of specific abilities were involved, 
and not a single ability. See Monroe, Walter S„ " The ability to place the 
decimal point in division,” Elementary School Journal, vol. 18, pp. 287-03 
(December, 1917). 
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in teaching the operations of arithmetic, we are attempting 
to engender a number of specific abilities which are relatively 
distinct, and not a single arithmetical ability. The word 
“ability” is used to refer to the rate and accuracy with 
which a pupil does a certain type of example. Teachers 
have reeognized that pupils could do subtraction examples 
in which there was no “borrowing” when they were unable 
to do examples in which there was “ borrowing,” or that 
they could do short division when they were unable to do 
long division. The investigations of vStone and others have 
proven that there are as many different abilities as there 
are types of examples. In fact, it is obvious that the abil¬ 
ity to add a column of three figures is not the same as the 
ability to add a column of twelve figures. In adding a col¬ 
umn of figures it is necessary that one hold in mind the 
partial sum until he has added the next figure. This process 
must be repeated until the final sum is reached, and a fail¬ 
ure to do this continuously will result in stopping the add¬ 
ing, at least temporarily. It is a frequent occurrence, for 
one who is not accustomed to adding long columns of fig¬ 
ures, to find that he has stopped, perhaps has even lost 
the partial sum, and must begin again. The span of atten¬ 
tion required in adding three figures is short, and pupils 
who are able to do examples of this type with a high degree 
of skill frequently are unable to add long columns of figures 
with an equal degree of skill. In fact, we have no reason 
to expect them to be able to do this type of example until 
they have practiced upon it. 

Courtis,^ the author of the Standard Research Tests, has 
identified the following types of examples in the operations 
with integers: 

Addition: (1) addition combinations; (2) single-column 

' Courtis, S. A., Teacher's Manxtalfor Courtis Standard PraeUoa Tests 
( 1010 .) 
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addition of tliree figures each; (3) “bridging the tens,” as 
38 + 7; (4) column addition, seven figures; (5) addition 
with carrying; (6) column addition with increased attention 
span, thirteen figures to the column; (7) addition of numbers 
of different lengths. 

Subtraction: (1) subtraction combinations; (2) subtrac¬ 
tion of 9 or less from a number of two digits, without “bor¬ 
rowing”; (3) same as the second, but with “borrowing”; 
(4) subtraction of numbers of two or more digits involving 
borrowing. 

Multiplication; (1) multiplication combinations; (2) mul¬ 
tiplicand two digits, multiplier one digit, and no carrying; 
(3) same as number 2, but with carrying; (4) long multipli¬ 
cation, without carrying; (5-8) zero difficulties, four types; 

SGO 807 017 703 

40 59 508 60 

(9) long multiplication, with carrying. 

Division: (1) division combinations; (2) simple division, no 
carrying; (3) same as number 2, but with carrying; (4) long 
division, no carrying; (5-6) zero difficulties, two coses: 

690 302 

71)48990 8l)0302 

(7) long division, with carrying, “first cose, the first figure 
of the divisor is the trial divisor and the trial quotient is the 
true quotient”: 

72 

e3)'4G36 

(8) “second case, where the trial divisor is one larger than 
the first figure of the divisor, but the trial quotient is the 
true quotient ”; 

63 

49)3087 
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(9) “third case, where the first figure of the divisor is the 
trial divisor, but the true quotient is one smaller than tb^J 
trial quotient”: 

89 

63)5607 

(10) “fourth case, where the first figure of the divisor must 
be increased by one to obtain a trial divisor and the second 
trial quotient must be increased by one to get the true 
quotient)”: 



Each a specific habit. Each of these types of examples 
requires a specific habit or automatism. To be sure, certain 
elements, such as the fundamental combinations, are com¬ 
mon, but careful analysis will show that the ability to do 
examples of one type is different from that required to do 
another. Not only will a careful analysis reveal this fact, 
but it has been repeatedly demonstrated by carefully con¬ 
ducted investigations. In addition to the specific auto¬ 
matisms which are required for the four fundamental op¬ 
erations with integers, a number of other automatisms are 
required for the operations with fractions both common and 
decimal. At present we have only partial analysis of the 
examples in these fields, and for that reason it is not possible 
to state what types of examples are within the range of 
school work. 

The significant characteristics of these abilities or auto¬ 
matic responses are the rate or speed of performance and 
the accuracy of the response. Thus, the measurement of 
arithmetical abilities involves determining only at what 
rate a pupil is able to do examples of the elemental types, 
and how accurate his answers are. This is accomplished by 
having him do examples of a given type for a specified time. 
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From his test paper his rate and per cent of examples cor¬ 
rect may be determined. These two quantities represent the 
measure of his ability to do this type of example.^ "■ 

Limitations of Series B. A complete and detailed meas¬ 
urement would require that a test be provided for each 
type of example, but fortunately certain combinations can 
be made. An example in addition consisting of three col¬ 
umns of nine figures each includes the addition combina¬ 
tions, simple column addition, and carrying. Thus, if a 
pupil responds satisfactorily to examples of this type, we 
know that he possesses the ability to do tlie types of addi¬ 
tion examples involved therein. On the other hand, if his 
response to this type of example is unsatisfactory, we do 
not know just what elemental ability he lacks. The use of 
a single test of this type, such as Series B, to measure a 
group of arithmetical abilities has this very obvious limita¬ 
tion in diagnosing the conditions which exist, but it does 
provide a very satisfactory general survey. 

Diagnostic Tests. Any series of classroom tests must not 
require a large amount of time if they are to be used by any 
besides the most enthusiastic workers. Thus, in construct¬ 
ing a series of diagnostic tests in the operations of arithmetic, 
due regard must be had for the amount of time that will be 
required. Bearing this fact in mind the writer has devised 
a series of twenty-one tests which require only thirty-one 
minutes of working time and which it is believed furnish a 
reasonably complete diagnosis of the abilities of pupils to do 

1 Strictly speaking, the number of examples done and the per cent of 
examples correct is a measure of the pupil’s performance rather than of his 
ability. A pupil's performance is aflfccted by many factors such as his emo¬ 
tional status, physical condition, light, temperature, and the like. Or, it 
may be that a pupil does not try to do his best on a given test. A pupil’s 
ability can only be inferred from bis performance, but when conditions are 
properly controlled, such inference is reliable in all except a few cases. In 
order to avoid an awkward form of statement and because the practice is 
general, we shall speak of a score as a measure of a pupil’s ability. 
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the operations of arithmetic with the exception of the types 
of examples involving mixed numbers and integers with 
fractions. In order to avoid an excessive number of tests it 
has been necessary to include more than one type of exam¬ 
ple within a single test. When this has been done the differ¬ 
ent types are closely related and they always occur in rota¬ 
tion. 

The following samples from each test will illustrate the 
types of examples included in the several tests: 


Addition 


Teat I 

Teat V 

Teat VII 

Teat XII 

4 

7882 

7 

1/6 + 1/3 = 

7 

6013 

6 

6> + 1/2 = 

2 

1761 

6 

8/l0 + 3/6 = 


6872 

5 

6/9 + 2/3 = 


8739 

0 


B 

1 

8 

7 

3 

3 

1 

2 ’ 


Teiixr 
1/0 -f 3/e = 
3/12 + B/8 >= 


Sublraclion 

Tetlll Ttttix 

87 04 780 1858 

5 8 867 m 


Tettxm 


8/4 - 2/5 
5/6 -■ 8/4 


Teat III 
6572 
6 


Teat XIV 

2/3 X 3/4 
2/5 X 3/7 
6/12 X 8/5 


MuUiplication 

Tell VIII 

4857 660 

_36 87 

TalXTIII 

657.2 67.50 

_^ .03 

- 46004 20260 


TeitX 

807 017 840 

m _80 

Te»t XX 

487,6 67.28 

_ M 0.5 

802260 544160 
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In Tests XVIII and XX the pupil is simply to insert the 
decimal point in the product which is given. In the samples 
only the variations in the multiplier are given. Each multi¬ 
plier is used with three tyxies of multiplicands (657.2, 65.72, 
6.572). Thus each test includes six types of examples. 

Division 

Tat IV TestVJ T eil XI TeiiXVI 

SjMlO 82)38S4 47;27fib0 2/S l/3 

4/7 ^ 2/3 
8/8 -i- 2/3 

Tat XIX Test XVII Test XXI 

.4JT48 Ans. ;37 03)1(12 Ann. :64 . 47)2768.0 Anti. :587 

.OjaO" Ans. :73 . 07)1782 Ans. :20 8.2)38 64' Ans. ;47 

.6)08 Ans. ;28 .OSjTilS Ans. :83 70)30.803 Ans, :407 

.7jTS0r Ans. :43 .00)7.44 Ans. :124 

Test XI is a composite test involving the four “cases” of 
long division given hy Courtis. In Tests XVIII, XIX, and 
XXI the pupil is to write the answer in the proper place 
and insert the decimal point. In Test XXI each of the 
three types of divisor is placed with each of four types of 
dividends thus providing twelve types of examples. 

Marking the test papers and tabulating scores. The test 
papers are marked in the same way as Series B. The scores 
are also recorded in the same way. Detailed directions ac¬ 
company the tests. 

Standards. Only tentative standards are available for 
these tests and they are likely to he changed somewhat in the 
future. For that reason they are not reproduced here. The 
best available standards are always furnished with the tests. 

Graphical representation. A plan of graphical representa¬ 
tion which makes very easy the interpretation of the scores 
of this series of tests will be given in the next chapter in our 
consideration of diagnosis. See Mgs. 25 and 26. 
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Summaiy. In this chapter we have described two series 
of tests for measuring the abilities of pupils to perforin the 
operations of arithmetic; Courtis’s Standard Research 
Tests, Series B, and Monroe’s Diagnostic Tests. The former 
is to be used for general measurement, the latter for diag¬ 
nostic measurement, In describing these tests we have 
shown that ability to do the operations is specific. In the 
next chapter the meaning of the scores and correctives for 
the defects discovered by using the tests will be considered. 
In Chapter VI tests for memring ability to solve problems 
will be described. 

QUESTIONS AND TOPICS FOR STUDY 

1, Wliat ia a general test? A diagnostic test? 

2, Wlien would you use a general test? A diagnostic test? 

3> 'What is diagnosis? 

4, How is the median calculated? 

B. What ia the “efficiency” of a class? 

0. What arc tlic "dimensions” of abilities to do examples? 

7. What do we mean by saying abilities to do examples are specific? 



CHAPTER V 


DIAGNOSIS AND CORRECTIVE INSTRUCTION IN 
ARITHMETIC 

Purpose of giving standardized tests is to furnish basis 
for improving instruction. As in the case of reading, the 
fundamental purpose of giving standardized testa in arith¬ 
metic is to secure information which the teacher may use 
in improving the instruction. Series B can be used to secure 
general information concerning the abilities of the members 
of a class. The scores will tell the teacher, for each of the 
four operations, whether his pupils are above or below 
standard in rate of work and in accuracy. With this infor¬ 
mation at hand, the teacher knows where he should place 
the emphasis in his instruction; that is, whether he is devot¬ 
ing insufficient time to practice upon the operations, or 
whether the pupils are being drilled when they are already 
up to standard, or whether he should place more emphasis 
upon the rate of work or upon accuracy. 

However, when we recall the nature of ability in the oper¬ 
ations of arithmetic, it appears that Series B cannot furnish 
as complete information as is necessary for planning details 
of instruction, such as the types of examples which should 
receive emphasis, A more elaborate series, such as Monroe’s 
Diagnostic Tests, is necessary. In certain cases it is very 
helpful to supplement tire diagnostic tests with an analytical 
diagnosis. 

In this chapter we shall consider (1) the meaning of scores 
obtained by using Series B and the instruction which should 
be given to correct the conditions revealed; (2) the use of the 
Diagnostic Tests and how to use the results; (3) supplemen¬ 
tary or analjdical diagnosis. 
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I. Courtis’s Standard Research Tests, Series B 

Type I. Below standard in both rate and accuracy. The 
causes. There is given in Fig. SI the record of a fifth-grade 
class for the addition test. The standards have been indi¬ 
cated by drawing heavy lines. The four divisions into which 
these lines divide the record sheet make the interpretation 
of the groups more simple. The records of this class for the 
other three tests are similar, showing that it is rather con¬ 
spicuously below standard in both rate and accuracy. Sev¬ 
eral causes for this condition are possible. The pupils may 
not know the tables. They may not have learned a good 
method of work. They may lack sufficient effective drill 
upon these tyiies of examples. In the absence of scientific 
information on this point it is the wiiter’s opinion that the 
last-mentioned cause is the most probable. Saying tliat the 
most probable cause is insufficient chill docs not necessarily 
mean that not enough time has been given to di-ill. Much 
time may be given to drill and the drill not be effective be¬ 
cause the teacher uses a poor classroom procedure. 

An illustration of inefficient drill. Frequently the writer 
has visited classes in arithmetic which were being drilled 
upon the fundamental operations. A fairly uniform pro¬ 
cedure was followed. The same example was dictated to all 
of the pupils, regardless of whether they needed drill upon 
this particular type of example or not. Naturally some 
pupils finished very quickly, and, as they waited for their 
classmates to finish, tliere was a tendency for them to be¬ 
come disorderly — a perfectly natural tendency. When a 
majority of the class had finished the example, the teacher 
stopped the work and read the correct answer. The process 
was then repeated, The result was that those pupils who 
worked slowly completed few, if any, examples during the 
entire period, and, therefore, received little satisfactory 



Teal No. 1 



Eig. 21. {Type I .) The Kecobd Sheet of a Eifth-Gsadb Class in Addition. Below Stahdabd in both: 

Bate and AccoHAcr. 
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drill. The bright pupils spent a considerable portion of 
their time waiting on the other members of the class, and 
probably did not need the particular kind of drill which 
they received. 

Some teachers spend a great deal of time in having exam¬ 
ples explained by pupils, the explanation consisting merely 
of an oral reproduction of the process of adding, subtract¬ 
ing, etc. There is a time in the learning process when pupils 
need explanation, but in the operations of arithmetic, after 
they understand what to do, attentive repetition is required. 
This requires an efficient plan of drill. Anotlier point which 
should be noted is that the drill must be upon all the types 
of examples which they are to learn to do and not upon the 
tables or some other single type. 

The remedy. (J) A modified classroom procedure. The 
type of class instruction described on page 130 can easily be 
modified so as to make the drill more efficient and to insure 
that the slow-working pupils will get some satisfactory drill. 
Instead of dictating only one example at a time, the teacher 
can dictate several, and stop the work as soon as a few of the 
faster workers have finished. The slow-working pupils will 
have some examples completed and the faster workers will 
not have been idle. 

(2) Rate of work must he recognized. The teacher must 
recognize that the rate at which the pupil performs the 
operations is important, as well as the accuracy. This means 
that, in teaching, the teacher must obtain a measure of the 
pupil’s rate, as well as a measure of his accuracy. If exam¬ 
ples are dictated in groups, and the work stopped as sug¬ 
gested in the above paragraph, the number of examples 
which the pupil does during the class period is a measure 
of his rate of working. The per cent correct is a measure of 
his accuracy. 

(3) Motivation. Another means of increasing the scores of 
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a class is to secure a strong motive for the work. Arithmetic 
is one of the best liked of the drill subjects. This is particu¬ 
larly true of the operations. This being the case, the moti¬ 
vation of drill in arithmetic generally is a comparatively 
simple matter, and in most cases it will be sufficient simply 
to start the pupils to work and to keep the work from lag¬ 
ging. When more than this is neeessary, the teacher must 
demonstrate her resourcefulness by providing an efieetive 
method or device for the motivation of arithmetical drill. 
In the lower grades the playing of certain games provides 
practice upon certain types of examples. In the upper 
grades ciphering-matches, or, better, the setting of definite 
standards in both rate and accuracy, are very effective mo¬ 
tives. 

Standards used to motivate work in arithmetic. The 
writer has visited classrooms in which the teacher had 
posted a chart giving the median scores of the class at the 
beginning of the school year and the standards which should 
be reached by the end of the year. Teachers testify that 
this is an effective means of stimulating interest. Eigures 
in the latter part of this chapter illustrate plans for repre¬ 
senting the standing of a class on a chart. 

Type n. Below standard in rate with satisfactory accu¬ 
racy. Sometimes a class will be found with a satisfactory 
median score in accuracy, but conspicuously below standard 
in rate of work. This condition may be due to the fact that, 
through the neglect of the rate of work by the teacher, the 
pupils have not been trained to work rapidly. It may be 
due to the pupils having the habit of applying some check 
to their work or doing it a second time. Some pupils work 
slowly because they are not concentrating their attention 
upon what they are doing. In giving tests the writer has 
observed pupils stop and look around the room or out of the 
window, showing thereby that they were working at a very 
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low pressure. Other pupils have been found to work slowly 
because they have acquired inefficient methods of work. 
One such method which is frequently found is the use of an 
elaborate phraseology or formula in performing the opera¬ 
tions. (This cause is treated more fully on page 149.) 

The remedy for this type of situation is primarily to place 
more emphasis upon the rate of work in classroom drills. 
The pupils should be given timed drills and judged upon 
the basis of their rate of work as well as the accuracy of their 
results. The modified classroom procedure suggested above 
makes this possible. If pupils have acquired liabits of work 
that are undesirable, such as counting on the fingers or 
tapping out sums or repeating the numbers to be added, 
subtracted, etc., they should be corrected. Also a strong 
motive will tend to increase the rate of work. In increasing 
the rate of work, care must be exercised to make certain 
that the pupils do not become inaccurate. However, as in 
the case of silent reading, high rate and high accuracy are 
not incompatible. In fact they frequently go together, and 
frequently an increase in the rate of work in arithmetic is 
accompanied by an increase in accuracy. 

T 3 q)e HI. Below standard in accuracy with satisfactory 
or high rate. If one takes the position that the only satis¬ 
factory standard for accuracy is one hundred per cent, this 
case occurs very frequently. If one accepts the general 
medians of Table XIV as satisfactory standards, it occurs 
much less frequently. In this discussion we shall accept the 
general medians as satisfactory standards. A median score 
in accuracy may be below standard because the test was 
given to the pupils in such a way that they became excited 
and worked very rapidly when tliey were accustomed to 
work slowly. When it is suspected that this is the cause, 
the test should be repeated, using a different form, and exer¬ 
cising cai-e not to excite the pupils. Pupils should become 
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accustomed to working under timed conditions by being 
timed in doing the regular class exercises. 

Another reason for a low median score in accuracy mar 
be the lack of sufficient practice upon the types of example.„ 
used in these tests. If this is the cause, the remedy is obvi 
ous, and the suggestions given above in respect to effective 
methods of drill will apply. 

Type IV. Scores too widely scattered. An illustration is 
given of this type of situation in Fig. 22. The median rate 
of this class is above standard and the median accuracy is 
only slightly below. Thus, as judged by its median scores 
the standing of this class is satisfactory, but the scores are 
not closely grouped about the central tendencies. Although 
the class is relatively small the rates of work vary from four 
examples to seventeen examples and the accuracy scores are 
recorded in each interval of the record sheet. This is an 
illustration of a condition which prevails to some extent in 
practically every class. Unless the class is very small, there 
will be a distribution of scores extending over several inter¬ 
vals of the record sheet. 

The overlapping of the several grades. When the distri¬ 
butions of the scores for successive grades are compared, a 
great overlapping is found. Some pupils in the fourth grade 
make higher scores than a number of the eighth-grade pupils. 
Table XV shows the distribution of pupils in a certain city 
according to the number of examples attempted in the sub¬ 
traction test of the Courtis Standard Research Tests, Series 
B. An examination of the table on page 120 reveals these 
facts; 

In the fourth grade twenty-three per cent of the pupik 
reach or exceed the fifth-grade median. 

In the fifth grade twenty-three per cent of the pupils 
reach or exceed the sixth-grade median. 

In the sixth grade twenty-four per cent of the pupils reach 
or exceed the seventh-grade median. 
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Eig. 22. {Type IF.) The Recoed Sheet of ae Eighth-Grade Class in Molupucation.- 

Scores too itidelt scattered. 
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Table XV. Showing the Disthibdtion of the Pupils of a 
City accobdinq to the Number of Examples Attempted, 
CouBTis’s Standard Research Tests, Series B 

Snbtmction 



In the seventh grade forty per cent of tlic pupils reach or 
exceed the eighth-grade median. 

This condition is merely typical. Three causes may be 
given; (1) imperfect classification of pupils; (2) native indi¬ 
vidual differences in the pupils; and (8) the training which 
they have received. As a rule only a few eases can be 
accounted for on the basis of imperfect cIa.ssification when 
we remember that except where the school has been depart¬ 
mentalized, the pupils have been grouped not only for in¬ 
struction in the operations of arithmetic, but also for in¬ 
struction in other subjects, and that pupils who are low in 
arithmetic may stand high in some other subjects. Native 
differences remind us that pupils are different and that 
complete uniformity cannot be secured. It is, therefore, 
the third cause which concerns us most. 

The effect of class instruction not suited to all pupils. The 
effect of class instruction is shown when a test is repealed 
after an interval of a few months. In Table XVI the mid¬ 
year^ distributions for a certain city on the addition test of 

* The first test was given just alter the midyear promotions. The testa 
Were given to about one hundred and fifty pupils In each grade. 
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TABtE XVI. The Range op Nombeb op Examples Attempted 

(Upper numbers for each grade arc for the mid-year test. Lower numbers 
refer to the May teat.) 

Addition 


Grad6 , 

Total Tango , 

1 

Xtango in number 1 
of examjilos 

lianm oj midiUo 
wpOTcent ' 

Uango in 
71167/1 hero/ 
examples 

IV.. 

1-XO 

10 

3.0- 5,0 

2.3 


1-17 

17 

6.0- 8.3 

3.3 

V. . 

2^14 

13 

4.7- 7,0 

2.3 


S-IO 

14 

C.B- 0,0 

2.2 

vr. 

2-12 

11 

6,7- 8.4 

2.7 


4-24 

21 

7.2-U 0 

3.8 

VTT. 

a-24 

22 

Q.9-10.0 

3.1 


4-24 

21 

8.6-12.3 

3.8 

vui..... 

4-lB 

16 

8.1-10,8 

2,7 


6-17 

16 

8.0-12.1 

3.2 


Series B are compared with those for May. With only two 
exceptions both the total range of the scores and the range 
of the middle fifty per cent were increased. This fact shows 
that the instruction in addition which these pupils received 
was more appropriate for the brighter pupils than for those 
who were below standard ability. Some pupils acquired 
abilities far in excess of the standards for their grade, while 
others remained conspicuously below the standard. This is 
merely what we should expect, because those pupils who 
have profited most under the system of instruction may be 
expected to continue to profit most. Obviously, if our stand¬ 
ards are wisely determined, the pupils who are below stand¬ 
ard in ability need instruction and those who are conspicu¬ 
ously above standard may spend their time more wisely 
upon other subject-matter. If this is not feasible, the 
methods and devices of instruction should be those most 













128 MEASURING THE RESULTS OF TEACHING 

appropriate to those pupils who are below standard. If the 
methods of instruction are unchanged, it is obvious that the 
pupils who have learned most readily will continue to do so. 

The bright pupil should receive consideration as well as 
the backward pupil. The usual class instruction does not 
give the bright pupil cfEcient training. He is not forced to 
exert himself. Much of the time he is forced to be inactive. 
Furthermore, in the case of the tool subjects (the operations 
of arithmetic, reading, spelling, handwriting, and language), 
training beyond a certain point is not very profitable. In 
arithmetic the bright pupil should be given problem work 
rather than additional training upon the operations. 

The remedy. Where reclassification of the pupils is pos¬ 
sible and appears wise in the light of the achievements of the 
pupils in other parts of arithmetic and in their other sub¬ 
jects, a closer grouping can be secured by promoting those 
who are conspicuously above standard. Some may be put 
back a grade. But it will be found that many pupils will be 
below standard only in certain items. To handle these cases, 
individual, or at least group, instruction is required, because 
it is obvious that all members of the class do not need the 
same instruction. Before individual instruction can be 
wisely planned, additional information concerning the mem¬ 
bers of the class is needed. This may be secured (1) by using 
diagnostic tests and (2) by analytical diagnosis. We shall 
therefore treat Type IV more fully under the head of 
Diagnostic Tests. 

Type V. Irregular development. Fig. 33 shows the median 
scores of two classes in a certain city. In the number of 
pyginplRH attempted. Class A is nearly three examples higher 
in subtraction and multiplication than in addition. Class B 
has very high scores in addition, but lower ones in the other 
operations, particularly multiplication and division. The 
relative position of the line showing the median number of 
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examples rlgiit shows Class A to be inaccurate in all opera¬ 
tions except division, where perfect or one hundred per cent 
accuracy is indicated. On the other hand. Class B, which in 
general is relatively 

very accurate in _MS_ 32 *___Ha 3 i____J 2 Av 

the other operations b 

does not attain per- ^ ^ ™ s;;"- 

feet accuracy in di- jg ^ 

vision. Suchirregu- \ 

lar or uneven de- tB __ \ 

velopment is not _\ 

unusual. It is more H-^— 

frequent and more i / 

pronounced in indi--- 

vidual pupils than ^ / . .. 

in classes. 7 ^ 

In Fig. 24 we e_ ^ _ 

show the records of a/ 

a girl who was tested ’- ^ -- 

twice with Series B, ^ 

first, as she was fin- - ^ - 

ishing the seventh 5 

grade and again as „ „ ^™ 

, , .. Fig. 23. Snowwo Mkbian Scoueb of Two 

she was completing Classes in sue Same City. (After Aeh- 
the eighth grade. laugh.) 

In the figure her 

records are indicated by broken lines and the position of 
the eighth-grade standards (Boston) are shown by the solid 
line. In the seventh grade this girl’s development M^as ir¬ 
regular. In subtraction she had fourth-grade ability (see 
Table XlV), and in addition she was about fifth-grade. In 
division she was above eighth-grade ability. 

Such uneven development in either a class or an individual 
pupil is probably caused by not properly distributing the 








tistmctioiis; On honzoat^ line after tfie word "Attempts,” piece s dot under tie Sgure repreaenthig tie nnmber oi 
ajnples yon heye tried, end on tic Imff after the word ‘‘Bights,” place a dot under the figure lepresentijig the number of ei- 
iples that you had right. Bcgmoing with the dgiue at riie top that Teptescnts your grade, draw a line through all the dots 
at yon haTe made. 
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drill. A study of the median scores of a class on the several 
tests of the series will tell the teacher where the most 
emphasis should be placed in the class instruction. A study 
of the records of a pupil will furnish information for planning 
individual instruction. In Pig. 24 the broken line drawn for 
the eighth-grade scores shows that the development of this 
pupil was evened up during that grade. Such complete 
evenIng-up of scores is unusual, but if the teacher places 
emphasis upon the operations in which low scores are made 
marked improvement will result. 

II. Monhoe’s Diagnostic Tests 

More detailed information is secured by using diagnostic 
tests. An illustration of the irregular development of a class. 
By using the diagnostic tests described on page 114, more 
detailed information can be secured concerning a class or a 
pupil. In Fig. 25 the median scores of three sixth-grade 
classes in one city are represented. The plan of grapliical 
representation is similar to that used in Pig. 7. The two 
Scores of a test are represented on the sides of an elongated 
rectangle, the number of examples attempted on the upper 
side and the number right on the lower side. The scale on 
each line has been chosen so that the standard scores of 
the twenty-one tests for a given grade fall on a straight 
vertical line. Thus the sixth-grade standards all lie on 
the vertical line drawn from VI, seventh-grade standards 
on the vertical line drawn from VII, etc. The scale on the 
lines has been omitted in order to prevent the crowding 
of the figure. The numbers and letters at the left of the 
figure give the number of the test and the operation. 

Series B has been used for several years in the city from 
which the sixth-grade records shown in Fig. 25 were taken, 
and we may therefore assume that conditions are as good 
or possibly better than in the average city. Classes A and 
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Fig. 26. Showing the Median Scoiies of Thbbb SiNTn-GBADB 

CiJiasEB. 

B have thirty-three pupils each and Class C twenty-three 
pupils. The figure shows two significant facts: (1) certain 
points of non-uniformity between the medians of the three 
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classes, and (S) the non-uniform abilities of any one of the 
classes. 

In certain of the tests, such as 2, C, 8, 15, 18, and 20, the 
median scores of three classes fall within an interval of about 
one grade. In others, notably Tests 13 and 21, the extreme 
difference is much greater. Evidently the teachers of the 
different classes have not been placing equal emphasis upon 
the different types of examples. Take, for example, the addi¬ 
tion tests (1, 5, and 7). The teacher of Class B has been 
placing much emphasis upon the type of example in Test 5 
(short-column addition with carrying), although it should 
be noted that she has not neglected the other types of ad¬ 
dition examples. On the other hand, the teacher of CIeiss 
C has neglected short-column addition (Test 1), while the 
teacher of Class A has given much emphasis to it. In Test 7 
there are represented three degrees of emphasis. 

The non-uniform character of the abilities of a class is 
very obvious from the irregularity of the lines representing 
their abilities. Perfect uniformity would be represented by 
a straight vertical line. The non-uniformity in tlie abilities 
is due to the failure of the teacher to place the appropriate 
degree of emphasis upon the several types of examples. 
Some types doubtless require more emphasis than others, 
and it is the teacher’s problem (or is it the problem of the 
maker of the course of study?) to determine the degree of 
emphasis which is needed for each type. 

An illustration of the irregular development of pupils in 
the same class. In Fig. 26 there are shown the scores of 
three sixth-grade pupils selected almost at random from 
Class A in Fig. 25. H. H. is a twelve-year-old boy, H. C. a 
ten-year-old girl, and D. H. a girl, age not given. One 
should expect greater variations when dealing with the scores 
of individual pupils, but the variations of these scores must 
be surprising to one who has not studied the subject. Each 
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Fig. 20 . Showing rnu Individual Scobes of Thbeb Sixth-Graeb 
Pupils in the Same Class. 

Class A in Fig* 25* 

of these pupils has scores on certain tests conspicuously be¬ 
low the standard for the fourth grade and on other testa 
has scores conspicuously above eighth-grade standards. 
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Since these pupils were members of the same class, they 
had probably received the same instruction, and yet the 
instruction which had been sufficient for one had not always 
been satisfactory for tlie others. Pupils differ in the instruc¬ 
tion which they need. The instruction whicli will cause one 
pupil to learn may make no impression on another. 

Arithmetic a complex subject. The facts described above 
show that the product of aritlnnetical instruction is com¬ 
plex, much more complex than teachers and supervisors gen¬ 
erally realize. The fact that the scores obtained by using 
these tests show such great variations in the relative degree 
of ability in the different types of examples, when the pupils 
have been measured with the Comtis Standard Research 
Tests, Series B, at regular intervals, is evidence of the need 
which exists for a series of diagnostic tests. Teachers are 
probably failing to place the appropriate degrees of empha¬ 
sis upon the different types of examples, because they are 
ignorant of what types exist, or do not know the degree of 
ability which has been attained by their class, and much 
less the degree of ability attained by the individual pupils. 
A series of diagnostic tests, such as described in cliapter IV, 
are valuable to the teacher in two ways: (1) a.s a statement 
of the important t 5 ^es of examples, and (2) as an instru¬ 
ment for diagnostic measurement. 

An illustration of individual instruction. To correct the 
individual defects individual instruction is needed, A 
teacher can fit his instruction in the operations of arith¬ 
metic to the needs of his pupils by preparing a number of 
sets of examples, each set being confined to examples of the 
same type. These sets of examples should be written on 
cards. Then, instead of dictating examples, the teacher can 
distribute the cards and have the pupils copy the examples 
from the cards. If the teacher studies the needs of his 
pupils, it will be possible for him to distribute the cards so 
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that each pupil will have the type of example upon which 
he needs practice. The pupil is probably injured by being 
required to practice upon the wrong type of example, and, 
hence, it is very important that each pupil be given the type 
of example upon which he needs practice. 

The Courtis Standard Practice Tests used for individual 
instruction. Comtis has devised a set of Standard Practice 
Tests,* which automatically diagnoses each pupil and fur¬ 
nishes the practice which he needs to remedy his defects. 
These tests consist of forty-eight sets of exercises, which 
“have been designed to cover every known difficulty in the 
development of ability in the four operations with whole 
numbers.” The latest form of these tests (1916) is arranged 
so that the pupils begin the series by taking Lesson 13, a 
test involving aU types of examples found in the first twelve 
lessons.® AU pupils who attain standard ability on this test 
are excused from the first twelve lessons, because they have 
demonstrated that they do not need the instruction which 
these lessons provide. As soon as a pupil who did not attain 
standard ability on Lesson 13 has finished the first twelve 
lessons, he takes Lesson 13 again to show that he is now up 
to standard. Lessons SO, 31, and 44 are also test lessons, 
and are used in the same way. 

Each of the lessons is printed upon a card and a copy is 
furnished to each pupil. The card is placed beneath a sheet 

* Full details regarding these teats may be obtained from tlie publishers. 
World Book Company, Yonkers, New York, and Chicago, Ulinois. 

Another aeries of exercises, known ns the “ Studeboker Economy Practice 
Exercises,” and based upon some of the same general principles, has been 
devised by J. W. Studebaker, Assistant Superintendent of Schools, Des 
Moines, Iowa. They are published by Scott. Foresman & Company, New 
York and Chicago. Other series of practice exercises have been devised, 
but, so far as the writer has examined them, they are leas complete and give 
less promise of eCEcient means of instruction. 

‘ All lessons except the test lessons are confined to a single type of 
example. 
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of transparent paper and the example is read through the 
paper, the work being done on the paper. The lessons have 
been constructed so that the standard length of time re¬ 
quired to complete each one is the same. They are also self¬ 
scoring. These two features relieve the teacher of the labo¬ 
rious work of scoring the papers, and make it possible for 
different pupils to be working upon different lessons at the 
same time. Thus, when a pupil has demonstrated that he is 
up to standard on any type of example, he may at once go 
on to the next lesson. If he is not up to standard on any 
lesson, his work makes the fact obvious, and he can remain 
upon that lesson until he acquires the necessary ability 
without interfering in the least with the work of the other 
members of the class. 

Thus, individual progress is provided for, and at the same 
time the group formation is retained. A considerable saving 
of pupils’ time is effected by excusing from drill those pupUs 
who demonstrate that they possess standard ability. These 
pupils can spend this time upon oUier work. 

The use of the Standard Practice Tests in ungraded 
schools. These Standard Practice Tests also simplify in¬ 
struction in ungraded schools. In fact they save more time 
there than in graded schools. The same lessons are used for 
all pupils in Grades four to eight. Only the time allowed 
differs. Thus, all of the pupils in a rural school could be 
instructed at the same lime and each pupil receive the prac¬ 
tice which he needed. 

The most important thing. However, it must not be for¬ 
gotten that any set of practice exercises is merely a teaching 
device. It is more important that the teacher explicitly 
recognize in her thinkiag that she is instructing a group of 
pupils who differ widely in native ability, experience, and 
training, that all do not learn in the same way, and that a 
limitation should be placed upon training. When she ex- 
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plicitly recognizes these facts, the resourceful teaclier will 
find many devices which will be helpful in adapting the in¬ 
struction to the needs of the pupils. 

ITT . ANALYTicAii Diagnosis 

The need for analytical diagnosis. Diagnostic tests, and 
to a lesser degree general tests such as Series B, locate defects 
in classes and in individual pupils, but they do not tell the 
teacher the cause of the defect. The Icnowledge of the exist¬ 
ence of the defect is very helpful to the teacher and she can 
proceed to eliminate it by increasing the amount of practice 
or by other devices as has been suggested in the preceding 
pages. Many cases will be corrected by such treatment, but 
some will not for the reason that the cause of the defect has 
not been removed. 

The method. Whenever a pupil is found to be conspicu¬ 
ously below standard, the cause should be sought by “ ana¬ 
lytical diagnosis.” This kind of diagnosis includes three 
types of procedure: (1) observing the pupil as he works; 
(2) studying his test papers; (3) having him do the examples 
orally. 

Defects discovered by observing the pupil as he works 
under normal conditions. Courtis^ recommends this method 
of diagnosis and lists seven possible symptoms for addition: 

1. Child’s movements very slow and deliberate, but steady. 

2. Child’s movements rapid, but variable. Adding accompanied 
by general restlessness, sighs, frowns, and other symptoms of 
nervous strain. 

3. Child’s progress up the column irregular; rapid advance at 
times with hesitation, or waits, at regular or irregular intervals. 
Often gives up and commences a column again. 

4. Child stops to count on fingers, or by making dots with pen¬ 
cil, or to work out in its head the addition of certain figures. 

^ Courtis, S. A., Teacher’s Manual for the Standard Practice Tests (World 
Book Company, 1915), pp. 15 ff. 
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e. Child adds each first column correctly, but misses often on 
second and third columns. 

6. Child’s time per example increases steadily or irregularly, 
particularly after two or three minutes’ work; i.e., 15 seconds each 
for fii-st five examples, 17 seconds each for the next five, 23 seconds 
for next two, 45 seconds for the next example, etc. 

7, Child’s habits apparently good and work steady, but answers 
^jrong. 

Methods of correcting these defects. Com-tis recommends 
the following correctives for these defects: 

1. Slow movements may be due either to bad habits of work or 
to slow nerve action. In the latter case, the difficulty will prove 
very hard to control. It is almost certain that no amount of train¬ 
ing will ever alter the nerve structure and so remedy the funda¬ 
mental cause. But in all such cases much can be done to generate 
ideals of speed, to help the child to eliminate waste motions, and 
to hold himself up to his best rate. 

In any case the procedure would be as follows; Ask the child to 
add the first example alone so tliat you may time him. Give him 
the signal when to start and let him signal when he has finished. 
Let him make several trials of the same example to make sure that 
he does not improve under practice. The teacher should then give 
the child the watch and let him time the teacher in wmlcing the same 
example. Comment on diSerence in child’s and teacher’s times. 
Then have the child write in small figures all the partial sums, as 
shown in the illustration. The teacher should again time the child, 
letting him read to himself the partial sums as rapidly ns 
he can. This will, of course, give the minimum time in 
which the child could possibly add the example. The “41 ® 
time records of a child with true defective motor control “97 ® 
will show slight improvement, if any, even with such aid, 
and probably the only procedure to follow in such cases '^61 

i,s to lower the standard to correspond. Wliere there is - 

a marked difierence in time between the original and this last 
performance, the child will get, for the first time in its life, per¬ 
haps, a perfectly clear conception of what working at standard 
speed re,ally means, as well as the sensation of really working at 
that speed. The teacher and child should then practice the same 
example over aud over luitil the child can without the crutches add 
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it at the standard rate. Now the teacher can give him the whole 
test again, urging him to work at his best speed and comparing 
his results with the first result. The improvement made by ten 
minutes of this kind of work enables the teacher to say that a 
proper amount of similar study would produce the changes de 
sired. 

But, some teacher will say, “Will the child not learn the exam¬ 
ple by heart?” This is precisely what is desired. A perfect adder 
has learned so many examples “by heart” that it is imjKJSsible to 
make up any arrangement of figures that wUl be in any way new 
to him. The child in the same way needs to perfect his control over 
each example until he finally attains to mastery over all. 

2. If the child gives evidence of nervous strain, check his speed, 
teach him to relax and to work easily and quietly. Get good habits 
of work first, then bring up speed and accuracy by degrees. The 
nervousness of a child is usually caused by social conditions, phys¬ 
ical health, or temperamental bias. In any event, it is diflBcult to 
control. Look out for a large fatigue factor in nervous children. 

3. Irregular speed up the column may be due to either of two 
factors; lack of control of attention, or lack of Imowledge of the 
combinations. The latter factor will be discussed in the following 
paragraph (4). Attention will be considered here. 

There is a limit to the length of time that a person can carry on 
any mental activity continuously. As time goes on, the mind tends 
to respond more and more readily to any new mental stimulus tlian 
it does to the old. The mind “wanders,” as it is said. The attention 
span for many children is six additions, for some only three or four, 
for others, eight, or ten, and so on. That is, a child whose attention 
span is limited to six figures may add rapidly, smoothly, and accu¬ 
rately, for the first five figures in the column, giving its attention 
wholly to the work. As the limit of its attention span is reached, 
however, it becomes increasingly difficult for it to concentrate its 
attention. The child suddenly becomes conscious of its own phy¬ 
sical fatigue, of the sights and sounds around it. The mind balkr 
at the next addition; it may be a simple combination, as adding 2; 
to the partial sum, 27, held in mind. It finally becomes imperative 
that the child momentarily interrupt its adding activity and attend 
to something else. If this is done for a small fraction of a second, 
the mind clears and the adding activity will go on smoothly for a 
second group of six figures, when the inattention must be repeated. 

It should be evident that these periods of inattention are critical 
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periods. If the sum to be held in mind is 27, there is great danger 
tliat it will be remembered as 17, 37, 26, or some other amount, as 
the attention returns to tlie work of adding. The child must, there¬ 
fore, learn to “bridge” its attention spans successfully. It must 
learn to recognize the critical period when it occurs, consciously to 
divert its attention while giving its mind to remembering accu¬ 
rately the sum of the figures already added. This is probably best 
done by mechanically repeating to one’s self mentally, “twenty- 
seven, twenty-seven, twenty-seven,” or whatever the sum may be, 
during the whole interval of inattention. Little is loiown about the 
different methods of bridging the attention spans and it may well 
be that other methods would prove more effective. The use of the 
device suggested above, however, is common. 

Giving up in the middle of a column and commencing again at 
the beginning is almost a certain symptom of lack of control of the 
attention. On the other hand, mere inaccuracy of addition (as 27 
plus 2 equals 28) may be due to lack of control over the combina¬ 
tions, If the errors occur at more or less regular points in a column, 
and if, further, the combinations missed vary slightly when the 
column is re-added, the difficulty is pretty sure to be one of atten¬ 
tion and not one of knowledge. 

4. Hesitation in adding the next figure, when not due to atten¬ 
tion, is usually due to lack of control of the fundamental combina¬ 
tions. In such cases, however, the hesitation or mistakes are usu¬ 
ally repeated at the same point on subsequent additions. The 
teacher should understand that it “takes time to make mistakes,” 
and whenever a lengthening of the time interval occurs, it is a 
symptom of a difficulty which must be found and remedied. 

In this case the remedy is not a study of the separate combina¬ 
tions. It has been proved ^ that for most children time spent in 
study of the tables is waste effort; that the abilities generated are 
specific and do not transfer. A child may know 6 plus 9 perfectly, 
and yet not be able to add 9 to 26 in column addition except by 
counting on its fingers. The conibinaMons must he learned, of course, 
but they should be learned by projclicing column addition. Follow the 
method outlined in paragraph (1) above, having the column added 
over and over again until both standard speed and absolute accu¬ 
racy have been attained. 

' See Bulletin no. 2, Department of CoHperative Besearch, Courtis 
Standard Testa. 82 Eliot Street, Detroit, Michigan. See also Journal of 
Educational Psychology, September, 1914. 
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5. The sums of a child who is unable to remember the numbers 
to be carried, but whose work is otherwise perfect, will usually have 
the first column added correctly, as well as all single columns. 
Unfortunately, however, inability to carry correctly is usually a 
fault of children with weak memories for partial sums in the col¬ 
umn. It is well, therefore, to test the carrying habits of any child 
that is inaccurate. Many children do not add the number carried 
until the end of the next column; it should, of course, be added to 
the first figure in the column. If necessary the number to be carried 
should be emphasized as by saying, when the sum of a column is 27, 
“carry 2” to one’s self as the 7 is written. This is again a time- 
consuming device which should be adopted only as a last resort. 
The carrying should be an automaUc, unconscious operation, Re¬ 
peated practice on a few examples until the same become so per¬ 
fectly familiar that a child’s whole attention may be given to es¬ 
tablishing correct habits of carrying will prove beneficial. 

6. Marked increases in the times required for the successive ex¬ 
amples of a test are an indication of a fatigue factor in the control 
of the attention. Some children are unable to carry on continu¬ 
ously a single activity, as adding, through even a four-minute time 
interval without a very great loss in power. Two courses are open 
to the teacher, one or the other of which is sometimes effective: one 
is to determine the exact length of the interval at which the child 
can work efficiently, and then try to extend the interval slightly 
each day; the other is to set the child at work on very long and 
very hard examples, and to lengthen the time intervals to fifteen 
or twenty minutes’ continuous work. Difficulties of this type are 
hard to remedy. 

Errors discovered by examining test papers. This method 
of diagnosis cannot always be used because some examples, 
e.g., the addition test of Series B, are such that the nature 
of the pupil’s errors caimot be deter m ined from his work. 
However, in common fractions and to a certain extent in 
subtraction, multiplication, and division of integers, the 
nature of the errors can be determined. 

An illustration of errors made on Series B. Glst^ exam- 

Gist, Arthur S., “Errors in the Fundamentals of Arithmetic”; in, 
School and Society (August 11, 1917), vol. 0, p. 176. 
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ined 812 papers of the Courtis Standard Research Tests, 
Series B, chosen at random from six schools in Seattle. The 
frequency, reduced to a per cent basis of each type of error 
for subtraction, multiplication, and division in the respec¬ 
tive grades, is shown in Table XVII. In subtraction “omis¬ 
sions ” refer to the number of pairs of digits omitted alto¬ 
gether. Reversions occur when 9 should have been taken 
from 8, but the digits were reversed. The error indicated 
by 7-0, is only typical of many similar mistakes when a 
cipher occurs. The left-hand digit caused some trouble in 
the eighth grade. In the example: 

107795491 

77197029 

129598462 

the left-hand digit was carried down, as shown. 


Table XVn. Feequency of Types of Eeeobb in Subikaction, 
Multiplication, and Division, based upon a Study op 812 
Test Papebs, Couetis’s Standakd Research Tests, Series B. 
(Gist.) 
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Errors in adding common fractions. The errors which 
pupils make in the addition of two fractions have been 
studied so that we know what types are most likely to occur. 
(1) Counts 1 foimd in a study of tests given to eighth-grade 
pupils that sixty per cent of the errors were due to adding 
the numerators for a new numerator and also adding the 
denominators for a new denominator, as S/5 +1/5 = 4/l0, 
or l/9 + 5/9 = 6/18. It will be noticed that these exam¬ 
ples constitute one of the simplest cases in addition of frac¬ 
tions. (2) Twenty-seven per cent of the errors were due to 
multiplying the numerators for a numerator and multiplying 
the denominators for a new denominator; as 3/5 + 1/5 = 
3/25, or 1/9 + S/9 = 5/81. (3) In a test where it was 
necessary to reduce the sum to the lowest terms and to a 
mixed number, Kallorn^ foimd that nineteen per cent failed 
to reduce the result to a mixed number and eighteen per cent 
failed to reduce it to its lowest terms. About half of these 
pupils failed to make either reduction. About one pupil in 
twenty failed to express the result correctly when reducing 
a fraction to its lowest terms, writing 20/15 =1 5/15 = 
1/3, instead of 1 5/l5 = 11/3. (4) Kallom also found 
certain methods of addition which waste the pupU’s time 
and tend to introduce errors: 

Approximately one third found it necessary to reduce the frac¬ 
tions to a common denominator in the first test when the fractions 
were already similar. Some of these children wrote the fractions 
over a common denominator, using for a common denominator the 
denominator of the similar fractions. Others, not noticing that the 
fractions already had a common denominator, used some multiple. 


^ Counts, George S., Arithmetic Testa and Studies in the Psychology of 
Arithmetic (Supplementary Educational Monographs, no 4, University of 
Chicago Press), p. 66. 

^ Boston Document no, 3. (1916.) Arithmetic; Determining the Achieve¬ 
ment of Pupils in the Addition of Fractions. Bullctiii; 7 of the Depart¬ 
ment of Educational Investigation and Research, p. IS, 
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making necessary reductions. For example, many children added 
3 /14 and 1 /14 by reducing the fractions to a common denominator 
of 196. In many cases they then made errors in their work, thus 
obtaining an incorrect answer to the example. Even if carried 
through correctly, this is an ineffective and wasteful way of doing 
such examples. 

Another method used by many individuals consisted of finding the 
least common denominator of sueh fractions\as 1/8 and 3/16 by 
finding the least common multiple of the denominators by short 
division as taught in many of the arithmetics. In such cases the 
following was found: 

2)8 - 16 
2)4 - 8 

2)2 - 4 2X2X2X2 = 16 

2)1 - 2 

1 - 1 

Errors in subtracting common fractions. Coimts found 
two errors which occurred very frequently in subtracting 
fractions having like denominators. (1) Numerators sub¬ 
tracted for the new numerator and the denominators sub¬ 
tracted for the denominator as 6/9—4/£)=2/0, or 
3/7 — 1/7 = 2/0. (2) Numerators multiplied for the new 
numerator and the denominators multiplied for the de¬ 
nominator as 0/9— 4/9 = 24/81, or 3/7— 1/7 = 3/49. A 
considerable number of pupils added when subtraction was 
indicated by a minus sign. This may have been due in 
part to the fact that both addition and subtraction were 
included in the same test, but the writer has found sim¬ 
ilar errors when the two operations were in separate tests. 

Correctives for these errors. The first essential for the 
correction of a defect in a pupil is the knowledge of its 
existence and nature. Without this knowledge attempts to 
correct it must be a random trying of methods and devices 
in hopes that some one will meet the need. Frequently the 
teacher who knows just what defects exist will be acquainted 
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with some method or device which will serve as an effective 
corrective. If he is not, a knowledge of the laws of habit 
formation, which is the type of learning involved in the 
operations of arithmetic, will help. 

The laws of habit formation. Stated in psychological 
terms, the first law is that in the beginning the attention of 
the learner shall be focalized upon the habit to be acquired. 
In terms of schoolroom practice this means that the learner 
shall understand what reaction is to be made to a given 
stimulus, and shall then react to it in the appropriate man¬ 
ner. This gives the learner the right start. 

The second law is that the accomplishment of the step 
outlined in the first law shall be followed by attentive repe¬ 
titions. It is not sufficient that there be simply repetitions 
or drill. The drill must be attentive. In the case of the 
operations of arithmetic this drill may be detached from the 
solving of problems, or it may be given in the solving of 
problems. 

The third law states that no exception shall be permitted 
until the habit is firmly established, which means that the 
attentive practice must be continued until the operation 
has become a habit; that is, has been made automatic. 

“Borrowing.” Table XVI shows that, for the pupils of 
Seattle, “borrowing” is the most frequent error in subtrac¬ 
tion. Some teachers insist that this error can be corrected 
by using the Austrian or additive method of subtraction 
instead of the traditional or “take away” method. Although 
we do not have enough information in order to be able to 
say positively which method is superior, it appears that 
the “ take away ” method is superior to the Austrian method. 
The latter method may be helpful to certain pupils who have 
difficidty with subtraction. There are two types of errors 
in connection with “borrowing.” (1) A pupil may fail to 
“borrow” when he should. (2) “Borrowing’’may become a 
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mechanical feature of subtracting and the pupil will “bor¬ 
row ” when the example does not require it. In the first case 
the pupil must be taught to “borrow.” If he has difficulty 
in grasping the idea, the additive or Austrian method may be 
presented. It may be that the first law of habit formation 
has been fulfilled and the pupil needs “attentive repeti¬ 
tion” or drill. It will also be helpful to have the pupil do an 
example several times before proceeding to another. In the 
second case it wiU be helpful to give some examples in which 
no “borrowing” is required. This will demonstrate to tlie 
pupil that “ borrowing ” does not always occur in subtraction. 

Combinations or tables. Errors in combinations were next 
to “borrowing” in frequency, and errors in tables stand at 
the top of the list in multiplication. Such errors may occur 
because the pupil does not know certain combinations or 
because he does not know them well enough. That is, the 
defect may occur in either the first or second law of habit 
formation. A few pupils have great difficulty in learning 
certain combinations. When this is known to be the case, 
these combinations should be singled out and be made a 
matter of special drill. Generally when errors in the tables 
occur in the fourth grade and above, the combinations 
should not be practiced upon separately, but as they occur 
in examples. The situation is the same as in addition. (See 
page l4l.) 

Remainder too large in division. Outside of errors in 
multiplication and subtraction this is the most frequent 
error in division. This error, as well as most of the other 
errors listed for division, is due to an imperfect plan of 
procedure; that is, to the failure to apply simple checks at 
certain steps of the work. The process of division is peculiar 
in that it is possible to avoid most errors by applying simple 
checks at certain stages of the work, and pupils should be 
definitely taught to do this. It is very simple to note whether 
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the remainder is too large by comparing it with the divisor, 
and this comparison should be taught as a regular step of 
division. 

Failure to reduce sum in addition of fractions. This error 
is also due to an imperfect routine. Pupils should be taught 
that the reduction of the answer to a mixed number and to 
lowest terms is always a part of the work when possible. 
These errors can be corrected in most cases by the teacher 
insisting that the reduction be made and providing practice 
in doing it. Practice upon reduction apart from addition 
will not be as effective as practice on it as a part of addition. 
It is a good plan to give no credit for work which is not com¬ 
plete, for the third law of hahit formation, permit no excep¬ 
tions, applies here. 

Incorrect methods in handling fractions. Doing such 
thing s as adding the denominators when adding fractions is 
due to the pupil having not fixed the procedure for addition. 
To correct such defects, the pupil should be shown the cor¬ 
rect procedure and drilled upon it. This drill should at first 
be upon only one type of example, but later lists of mixed 
types should be used. Here is a good opportunity to use lists 
written on cards which may be distributed. This makes it 
convenient to time the pupils, and this is very important 
because it requires the pupil to decide quickly upon the 
method to use. 

Time-wasting methods. Kallom (p. 144) reports a num¬ 
ber of pupils using methods which require more time than is 
necessary. This wiU be corrected to a large extent by the 
teacher emphasizing the rate of work as being important. 
Of course, it is more important that a pupil have his work 
correct than to work rapidly, but frequently it is helpful to 
emphasize the rate of work. 

Analytical diagnosis by the oral method. By having a 
pupil do examples orally, it is possible to discover (1) par- 
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ticular errors in the combinations and (2) imperfect and 
wasteful methods. 

Illustrations of wasteful methods. By using this method 
of diagnosis the writer has found that in addition many 
pupils repeat each number to be added. For example they 
say, “7 and 6 are 13 and 5 are 18 and 4 are 22 and 5 are 
27,” instead of simply calling the partial sums, as “ 13, 18, 
22, 27.” Similar elaborate phraseology is used in the other 
operations. No error is involved in this method, but it 
consumes time. 

Uhl’s oral diagnosis of errors. Using Lesson 1 of the 
Courtis Standard Practice Tests, which consists of single- 
column addition, three figures to the column, Uhl ^ studied 
the errors of pupils by having them do the examples orally 
and by asking them detailed questions when their method 
was not made clear. To illustrate the method and also the 
nature of the defects revealed we quote from his report: 

The findings as to methods employed by pupils in “difficult” 
combinations is both interesting and significant. The following 
methods were found in the work of pupils who were tried out in the 
manner just described. A fourth-grade boy showed by slow work 
that the combination 9-7-5 was difficult for bun. When ques¬ 
tioned, he showed that he used a common form of “breaking-up” 
the larger digits. In working the problem, he said to himself: 
"9-h2+2+2-fl = 16 and 21.” This shows that the 9-7 com¬ 
bination was not known, but that the 16-5 combination was, in¬ 
asmuch as he arrived at “21” directly after having combined the 
other two numbers. Another boy of the same grade showed the 
same type of difficulty in a more pronounced form. He added 8, 6, 
and 0 as follows; “First take 4, then take 2, then add 8 and 4 makes 
12, and 2makes 14.” In adding 9, 7, and 5 he said: “9 and 3 is 12 
and 4 is 16 and 2-18; and 2-20; and 1-21.” He broke into parts 
even so easy a problem as 3 -f- 4 -f- 9, adding 9-1-3-1-2-1-2=16, 


* Uhl, W. L., “The Use of Standardized Materials in Arithmetic for 
Piagnosing Pupils’ Methods of Work”; in Elementary Sehool Journal 
(November, 1917), vol. 18, p. 215. 
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A pupil from the fifth grade presented a quite different method 
of adding. In adding 4, 9, and 6 she explained: “Take the 6. then 
add 3 out of the 4. Then 9 and 9 are 18, and 1 are 19.” Other 
problems were worked out similarly; one containing 3, 9, and 8 was 
solved as follows; “8 and 8 are 16 and 3 are 19 and 1 are 20”; 5, 6, 
and 9 as follows: “6, 7,8,9, and 9 arc 18 and 2 are 20.” This tend¬ 
ency to build up combinations of 8’s or 9’s continued in the case of 
another problem: 6, 5, and 8 were added thus: “6, 7, 8, and 8 are 
16 and 3 are 19.” Probably her first problem was worked similarly, 
but I had to have her dictate her method twice before I understood; 
she then gave it as quoted. 

Methods which are quite as clumsy are found in the case of sub¬ 
traction, One boy of the fifth grade was found to build up his sub¬ 
trahend in the case of many problems. For example, in subtracting 
8 from 37, he increased his subtrahend to 10, then obtained 27, and 
finally added 2 to 27 to compensate for the addition of 2 to 8. Like¬ 
wise, in subtracting 7 from SO, he added 3 to 7 and proceeded as 
before. This boy knew certain combinations very well, but did 
problems eontaining other combinations by a method much harder 
than the correct one. 

Even greater resourcefulness was shown by a fifth-grade boy 
who found the diflerencea between some numbers by first dividing, 
then noting the remainder or lack of one, then multiplying, and 
finally adding to or taking from the result as necessary. For ex¬ 
ample, in subtracting 9 from 44, he proceeded as follows: “Nine 
goes into 44 five times and 1 less; 4 times 9 are 36, minus 1 equals 
36.” That is, this boy knew certain multiplication combinations 
better than he did certain subtraction processes; therefore, he used 
multiplication, making adjustments either upward or downward 
as demanded by the problem. 

The Remedy. Where a pupil simply uses an elaborate 
phraseology he should be trained to use a simplified method. 
The plan of timing the pupil and then having the pupil time 
the teacher, or comparing his rate with the standard rate, 
will show him that his method is slow. The use of such 
methods as described above in the earlier grades may be 
justified, but teachers should make certain that they are 
replaced by more efficient ones later. It will help to recog- 
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nize the rate of work as an important “dimension” of the 
ability to do examples. When a pupil is found who does not 
know certain combinations, but is doing the examples by 
an ingenious method of counting, he must be taught thes< 
combinations. 

An illustration of corrective instruction. A fiflh-gi'ade 
class ‘ was given the Cleveland Survey Tests ^ to determine 
the types of examples which the pupils could not do with 
standard ability. This information was supplemented by 
oral diagnosis in correcting the defects revealed. The regu¬ 
lar “class instruction was supplemented at other periods 
in the day by special help to different pupils in the proc¬ 
esses in which they were weak, and they were required to 
work extra examples in those processes after the help had 
been given. The drill was limited to the four fundamental 
operations with integers and fractions. At the end of a 
month of this kind of instruction, the pupils were given the 
original test a second time.” 

In Fig. 27 the record of one pupil, who made some very 
low scores on the first test, is shown. The figure is so drawn 
that if the pupil were just up to standard in each test 
(A, B, C, D, etc.), the line representing his record would be 
a straight horizontal line. The solid line represents his first 
record and the broken one his second record. Corrective 
work was attempted in Tests A, B, F, I, N, and O, and the 
figure shows a marked improvement was made in these tests. 
By planning the corrective instruction more carefully it is 
probable that a still more uniform development might 
have been obtained. However, as it is we have a striking 
illustration of what can be accomplished when a diag- 

* Smith, James H., “Individual Variations in Arithmetic”; in Elemem 
tary School Journal (November, 1910), vol. 17, p. 108. 

“ These tests are similar to Monroe’s Diagnostic Tests except that they 
contain no tests on decimal fractions. 
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Dosis of a pupil is made and the instruction is based upon 
the diagnosis. 

Summaiy. In this chapter v?e have considered the causes 
of and corrections for the following types of class scores; (1) 
below standard in both rate and accuracy; (2) below stand- 



Fiq. 27. Showinq Two RECoana of One Pnpn. on the Cleveland 
S uBVET Tests. 

!^rat record, solid line. Second record, lour weeks later; dotted line, corrective work given 
on Tests A, B, F, I, N, and 0. 


ard in rate with satisfactory accuracy; (3) below standard 
in accuracy with satisfactory or high rate; (4) scores too 
widely scattered; (6) irregular development. In connection 
with the case of irregular development the value of diagnos¬ 
tic tests was pointed out. In dealing with individual pupils 
who are below standard analytical diagnosis is helpful for 
discovering the cause of the defect. Several illustrations of 
this method of diagnosis have been given together with the 
correctives for handling each case. 

QUESTIONS AND TOPICS FOR STUDY 

1. Do you think pupils will welcome detailed objective standarda and 
the use of standardized teats? Why? 

2. If you are using standardized tests make charts showing class (or 
individual) scores in comparison with the standards. Some teachers 
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have found it heJpful to have such charts hung in the classroom. 
It is also helpful to bring such charts to the attention of tlie pa¬ 
trons of the schooL 

8. Make a chart showing how the pupils of your class compare with other 
classes of the same grade and with classes of other grades 

4. Suppose a pupil is unable to do satisfactorily certain types of exam¬ 
ples. How would you proceed to locate his particular difficulties? If 
you are teadiing arithmetic, try out your plan on some of your pupils. 

5. What device do you use to provide each pupil with the training 
which he needs? What devices are suggested in this chapter? Can 
you suggest additional ones? 

6. Pupils who are excused from drill because they do not need it should 
spend their time doing profitable things. Suggest a number of assign¬ 
ments which might be made to such pupils. The assignments may 
be in subjects other than arithmetic if it seems wise, hut they should 
be such as not to interfere with the instruction of the other pupils. 

7. How do you know that the methods and devices of instruction which 
you are now using are the best? How could you find out? 

8. How do you know that you are not giving too much time to arith¬ 
metic? How could you find out? 

0. Is a class score whicli is conspicuously above standard a sign of 
superior teaching? Why? 

10. Construct two tests, each being confined to a single type of example. 
Give both tests to the same pupils_,under the same conditions. Com- 

f pare the two sets of scores. 

11. Scientific experimentation will be necessary to determine the best 
plans of grouping pupils for instruction. These plana are worthy of 
a trial. 

0 . In a building place together for drill those pupils which are most 
nearly equal in ability as shown by the tests, 

6. Excuse from drill those who have demonstrated that they are 
above standard. 

c. Have a special “hospital” class for those pupils who have scores 
conspicuously below standard. A pupil’s sentence to the "hospi¬ 
tal” would be until he brought his scores up to standard. 



CHAPTEE VI 

THE MEASUREMENT OF ABHJTY TO SOLVE PROBLEMS 
AND CORRECTIVE INSTRUCTION 

Description of Monroe’s Standardized Reasoning Tests, 
The measurement of the ability of pupils to solve problems 
requires a list of problems whose diflSculty or value has been 
determined, because we saw in Chapter I that problems are 
not equally diflBcult. Monroe’s Standardized Reasoning 
Tests consist of a series of three tests: Test I for the fourth 
and fifth grades, Test II for the sixth and seventh grades, 
and Test III for the eighth grade. Two forms of each test 
are available so that when it is desired to test the pupils a 
second or third time, it is not necessary to use the same list 
of problems. Each problem has been given to several hun¬ 
dred pupils and its value has been determined both for cor¬ 
rect principle and for correct answer. Thus, each problem 
has two values, one a “principle value,” which represents 
the credit to be given for correct reasoning in solving it, 
and the other a “correct answer value,” which represents 
the credit given for making the calculations correctly when 
the problem has been worked according to the correct 
principle. 

An important feature of these tests is the manner in which 
the problems were selected. The writer believes that a satis¬ 
factory reasoning test must be composed of problems which 
are representative in language and content. In order to 
secure such a list the one- and two-step problems in eight 
widely used textbooks, which totaled about nine thousand 
problems, were collected and classified according to the 
language in which they were stated. The necessity for this 
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classification wiU be taken up later under the head of 
“ Diagnosis.” The types of problems used in the tests oc¬ 
curred in at least five of the eight textbooks, which insures 
that the language of the problems is representative of that 
used by the authors of our textbooks. 

The tests are printed so that the pupil has space to do 
each problem on the test paper beside the printed state¬ 
ment of it. This eliminates the necessity of copying either 
the problem or the work. Thus, the teacher has a complete 
record of the pupil’s work which is valuable for making an 
analytical diagnosis. The following problems will illustrate 
the nature of the tests: 

A farmer raised 500 bushels of wheat 
on a field of 40 acres. What was the 
average yield per acre? 

A tailor uses Of yds. of cloth for a suit. 

How many yards wUl it take for S2 
suits? 

A field is 20 rods long, and 12 rods wide. 

How many rods of fence are needed 
to enclose it? 

How much more is earned per day by a 
man receiving $30 per week than by 
a man earning $18 per week? 

Method of giving the tests. Detailed instructions for giv¬ 
ing the tests axe printed on the test sheets and thus need 
not be repeated here. One point, perhaps, should be ex¬ 
plained. In the case of silent reading and the operations of 
arithmetic, we have emphasized the fact that ability was 
“two-dimensional”; that is, that the rate was important as 
well as the comprehension or accuracy. In solving a prob¬ 
lem, the relative importance of rate as a “dimension” of the 
ability is less, but probably should not be neglected. Ac* 


Principle value 2 
Answer value 2 

Principle value 1 
Answer value 2 

Principle value 2 
Answer value 1 

Principle value 3 
Answer value 2 
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cordingly the directions for giving the tests require the pupil 
to mark the problem, which he is working on at the end of a 
given number of minutes and then he is allowed to finish 
the test. This gives a rate score and also a score independent 
of the rate of work. 

Scoring the test papers. Instructions for scoring the pa¬ 
pers are furnished with the testa, but certain points should 
be noted here. In order that the “ability to reason” may 
be measured separately from the “ability to perform opera¬ 
tions,” each problem is marked for both “correct principle” 
and “correct answer.” A solution is marked correet in 
principle when it shows that the pupil has reasoned cor¬ 
rectly. If a pupil fails to remember correctly some fact, 
such as the number of pounds in a bushel of wheat or the 
number of square feet in a square yard, his reasoning is not 
affected. An answer is counted as correct when (1) the solu¬ 
tion is correct in principle and (2) also the answer is numer¬ 
ically correct and in its lowest terms. 

Each pupil is given three scores; (1) "Rate of reasoning,” 
which is the sum of the “principle values” of the problems 
solved within the time limit allowed, (2) “Correct reason¬ 
ing,” which is the sum of the “principle values” of all the 
problems solved correctly in principle, (3) “Correct an¬ 
swer,” which is the sum of the “correct answer values” 
of those problems which were solved correctly in principle 
and for which the correct answer was obtained. 

Recording the scores. The class record sheet is similar to 
that used for Monroe’s Standardized Silent Reading Tests. 
A blank for recording the third score is provided. This 
record sheet and detailed instructions for recording the 
scores are furnished with the tests. The median scores of 
the class may be calculated either by the directions given 
for the Standardized Silent Reading Tests on page 29, or 
by the directions for Series B on page 104. 
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Standards. These teats have been used only in a prelim¬ 
inary form, and for this reason standards have not yet been 
announced. However, standards will be determined as soon 
as reports have been received from a sufficient number of 
schools, and any one who is interested may obtain them by 
writing the Bureau of Educational Research, University of 
Illinois, Urbana, Illinois. 

Interpretation of class records. Because the final form of 
these reasoning tests has not been used, it is not possible to 
give typical class records upon which to base this discussion 
of the interpretation of scores. However, the preliminary 
form was given to over thirteen thousand pupils, and upon 
the basis of these results types of situations which require 
correction can be predicted with a high degree of certainty: 
Type I, low median score for “Rate of reasoning”; Type II, 
low median score in “correct reasoning”; Type HI, low me¬ 
dian score in “correct answer” indicating inaccurate calcu¬ 
lation; Type IV, scores too widely scattered or distributed. 

Type I. Median score for “ rate of reasoning ” below 
standard. From the nature of the test it is obvious that the 
rate of reasoning is not measured separately from the rate of 
calculation, for a pupil not only “reasons out” a problem, 
but also performs the necessary operations before he pro¬ 
ceeds to the next one. Hence, the “rate of reasoning” score 
is a measure of the rate of reasoning plus the rate of calcula¬ 
tion. For this reason a score may be below standard either 
because the pupil was slow in his reasoning or because he 
was slow in performing the operations. This fact must be 
kept in mind in interpreting this type. 

In the preliminary test some classes worked much more 
slowly than others, apparently because they had not formed 
the habit of working rapidly. This was probably due to the 
teacher failing to recognize the rate of work as important. 
The writer does not believe the rate of work is as important 
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in solving problems as in performing the operations of arith¬ 
metic, but it is his judgment that the rate of reasoning should 
not be neglected. The teacher should at least occasionally 
time pupils when they are solving problems, telling them, 
however, that it is more important to have their work right 
than to solve a large number of problems. 

Stone ^ tells of the case of one pupil who had not learned 
how to work rapidly: 

Pupil, H. C. 

Diagnosis; Up to standard in reading ability, did not indulge 
in undue labeling, physical examination showed no defects, con¬ 
stantly made low scores. Conclusion as to cause of low score: 
Menial laziness with lack of realization of the passing of time. 

Treatment: The pupil was first of all made conscious of his 
status by comparing his score with those of his fellow classmates 
and with the standard; then he was helped to study his way of 
working which convinced him of the seat of his difficulty. Ftom 
day to day lists of approximately equivalent problems were given 
him with time limit. Much was made of record of scores, gain 
being expected by both teacher and pupil. 

Results: Within a few days notable gain appeared, due to in¬ 
creased ability to direct and hold attention to the work in hand. 
Contrasted with his previous tendency to wander, the pupil be¬ 
came capable of working continuously in spite of such distractions 
as people entering the room. After about twenty minutes daily 
for three weeks he raised his score from 4 to 5.4.* Though this is 
not a large gain in score, the boy had made it largely of his own 
initiative; he had formed an ideal of concentration, and the con¬ 
cept of giving attention to reasoning processes was well under way. 
It is believed by those who have studied the boy that much of his 
improvement was due to the convincingness of the objective evi¬ 
dence of his need to improve. 

Some pupils worked slowly because apparently they did 
not know how to think out the plan of solution. They would 

' Stone, C. W., Standardized Reasoning Tests in Arithmetic and How to 
Utilize Them. Teachers College (1916), p. 83. 

* These scores refer to Stone’s Reasoning Teats. 
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try one plan and then erase their work or cross it out and 
try another plan. In such a case the pupils need to be taught 
how to think. This situation occurs more frequently with 
individual pupils than with whole classes, and for that 
reason the corrective measures will be discussed under that 
head. 

A low median score, due to slowness in performing the 
operations, may occur in two ways. First, the pupils may 
not be trained to perform the operations rapidly. This can 
be verified by giving a test upon the operations such as 
Series B. If their scores on these tests are below standard in 
rate, the correctives given on page 123 should be applied. 
Second, the pupils may be recording their work in some 
particular form which the teacher requires. The pupils in 
some classes write out the solution in the form of an analysis 
or record in other ways which consume time. Orderliness 
and system are desirable. In a reasonable degi'ee they are 
necessary, especially when the solution of a problem is long. 
But it should always be remembered that they are a means 
or method for making the solution of the problem easier. 
The teacher should not insist upon a particular form or 
system when it interferes with the pupil’s Work. 

An illustration of low rate of work due to this last cause 
and the effect of corrective treatment is given by Stone: ^ 

Some pupils of a certain fifth grade 

Diagnosis; Many pupils made very low scores, many papers 
much covered with such statements as, “If one tablet cost 7 cents, 
St tablets . . . etc.” Here was evidently one large source of failure. 

Treatment: Emphasis was placed on the possibility of saving 
time by not -writing so much, brief labels were devised, originality 
was encouraged, and approval of pupils and teacher placed on 
briefest adequate statement. 

* Stone, C. W., Standardised Reasoning Tests in Anthmetic and How to 
JJtihze Them. Teachers College (1916). p. 23. 
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Results: As shown by second test and by daily work, much time 
was saved for reasoning processes. The following parallel columns 
show typical results: 

Pupil, A. K. 

In first test In second test 

They would cost $18. $2.50 X 9 = $22.60 

If one suit coat $2.50. 9 would $2.00 X 9 = $18. 

cost $2.50 X 9 = $22.60. $4.0,50 

They would cost $40.50. 

Score in first test, 1 l/3. Score in second test, 3. 

Pupil, L. I. C. 

In first test In second test 

If he sold 4 papers and got twenty 5 One half would be 10 
cents for them, one half would be 10 cents and he could buy 
cents, and with the otlier 10 cents he 20 

bought Sunday papers, he would buy 
as many as 2 will go into 10 or 

2 )10 Score in second test, 4 l/2. 

6 papers. 

Score in first test, 3. 

Type II. Below standard in correct reasoning. In order 
to understand the reasons for a class being below standard 
in reasoning and the corrective measures which should be 
used, it is necessary to understand just what is required of 
the pupil in solving a problem. The process of solving a 
problem by reflective thinking may be described in the 
following steps: 

1. It is necessary that the pupil read the statement of the 
problem with understanding. This is a complex process and 
involves several abilities: eye-movement, perception, asso¬ 
ciation of meaning with symbols, and combining the several 
elements of meaning into an understanding of the problem. 
Out of this should come a definition of the problem, which 
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is the first step in r^ective thinking. It sliould be noted that 
two kinds of words occur in the statement of problems; 
first, words which describe the setting of the problem or the 
particular environment in which it occurs, and second, words 
which define quantities or quantitative relationships. This 
second class of words we may call technical. The meanings 
associated with them must be exact. Take, for example, this 
problem, “What is the value of sugar obtained at a Vermont 
sugar camp if it is worth ten cents per pound and six potmds 
are obtained on an average from each of 1275 maple trees? ” 
Words in this problem such as “Vermont,” “sugar,” 
“maple,” and “camp” describe the setting. They have 
nothing to do with the solution of the problem. The tech¬ 
nical words are such as “value,” “per poimd,” “are ob¬ 
tained,” and “each.” They define the relationships which 
exist between the quantities and are cues for formulating 
the hypothesis or plan of solution which is another step in 
the process. 

2. Principles applicable to the problem must be recalled. 
For example, in the problem, “A man invests $893 in some 
property. He sells the property for $1050. What is his rate 
of profit?” it is necessary to recall the principle that the 
rate of profit is calculated upon the amount invested and 
not upon the selling price. The principles and the meanings 
of the technical words are the data, or facts which are used 
in the reflective thinking. 

3. The elements of meaning and the recalled principles 
are used in formulating a plan of procedure or hypothesis 
concerning the operations to be performed upon the quanti¬ 
ties of the problem. In doing this each element of meaning 
must be given its proper weight. A relatively inconspicu¬ 
ous term may require an operation. For example, in the 
problem, “A rectangular court 72 feet by 120 feet is to be 
paved at a cost of $2 per square yard. What will be the ex- 
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pense? ” the use of “square yard” instead of “square foot” 
in the statement of the problem makes necessary an addi¬ 
tional operation. 

4. The hypothesis thus formed should be verified. Gen¬ 
erally this does not occur as an explicit step. It consists of 
seeing that the hypothesis is in agreement with the several 
elements of meaning and the recalled principles. 

5. The operations outlined in the hypothesis are per¬ 
formed. Strictly speaking, this is not a step in the reasoning 
process. This is completed when a correct plan of action is 
formulated. 

This analysis assumes that the problem is solved by 
refiective thinldng. In many cases the pupil does not reflect. 
If it is very familiar he may automatically identify it as 
requiring a particular operation or operations. This may 
happen after only a partial reading of the problem. Under 
any circumstances this procedure is probably more of the 
nature of a “short-circuiting” of the reflecting thinldng proc¬ 
ess than an exception to it. When the problem is unfamiliar 
the pupil may try random guessing at the plan of solution. 

It was noted that the data used in solving a problem come 
from two sources, recalled principles and the meanings of 
the technical words used in the statement. The ability to 
associate the correct meaning with one term does not imply 
the ability to associate the correct meaning with another 
term. The ability to solve the problem, “At $55 each how 
much must a farmer pay for 25 cows? ” does not make certain 
the possession of the ability to solve “ Find the duty on $600 
worth of clocks at 40% ad valorem,” although the same 
operation is required. The technical terms, such as “$55 
each,” “pay for,” “find the duty,” and "ad valorem,” are 
sufficiently different so that a pupil might know the mean¬ 
ing of one set without knowing the meaning of the other. 
The meaning of the technical terms in a problem furnishes 
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important data or cues for the judgment concerning the 
operations to be performed. In many cases it appears that 
the determining data come from this source. Thus, in meas¬ 
uring a pupil’s ability to solve printed problems we are meas¬ 
uring his knowledge of technical terms as well as his ability 
to use this knowledge in formulating plans of procedure. 

The reading of problems is difficult because many forms 
of statement are used. The solving of a problem requires a 
careful reading of it with a high degree of understanding 
and such reading of problems is a more complex and difficult 
task than we commonly realize. Problems are stated in 
many forms and the total “technical” vocabulary which is 
required of a pupil by the time he completes the work of the 
elementary school is a large one. For an illustration, take 
this problem situation: Given $7.50 paid for silk and price 
per yard $1.50, to find number of yards purchased. Exclud¬ 
ing different arrangements of the words used, twenty-eight 
different forms of statement were found in examining eight 
textbooks for describing this problem situation, and addi¬ 
tional forms could be constructed. 

1. How many yards of silk at $1.60 per yard can be bought for 
$7.50? 

2. The silk for a dress cost $7.60. How many yards were pur¬ 
chased at $1.50 per yard? 

3. At $1.60 per yard, how many yards of silk does a woman get 
it the amount of the purchase is $7.60? 

4. At the rate of $1.50 per yard my bill for silk was $7.50. How 
many yards were purchased? 

5. How many yards of silk at $1.60 a yard does a bill of $7.60 
represent? 

6. When silk is $1.60 a yard, a piece of silk costs $7.60. How 
many yards in the piece? 

7. At $1.60 a yard how many yards of silk does a merchant sell 
if he receives $7.50 for the piece? 

8. Mrs. Jones purchased silk at $1.60 a yard. The entire amount 
paid was $7.60. How many yards were bought? 
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9. Silk was sold at $1.50 per yard. A check for $7.60 was given 
in settlement. Find the number of yards bought. 

10. At $1.60 per yard, how many yards can be bought for $7.50.? 

11. A merchant sells a number of yards of silk for $7.50. The 
price being $1.50 for each yard, how many does he sell? 

12. I invested $7.50 in silk at $1.60 per yard. How many yards 
did I buy? 

13. When silk is $1.50 per yard, how many yards can be bought 
for $7.50? 

14. When silk is sold for $1.50 for each yard, what quantity can 
be bought for $7.50? 

16. At the rate of $1.60 per yard, how many yards can be bought 
for $7.50? 

16. Silk is selling for $1.50 per yard, how many yards should be 
sold for $7.50? 

17. At a cost of $1.60 a yard, how many yards can be bought for 
$7.50? 

18. Silk was bought at a cost of $1.50 per yard. At that rate, 
how many yards can be bought for $7.60? 

19. At $1.60 a yard a piece of silk cost $7.60. How many yards 
in the piece? 

20. How many yards of silk at $1.50 can I buy for $7.60? 

21. $7.50 was paid for silk at $1.60 per yard. How many yards 
were bought? 

22. Find the number of yards; cost $7.60. Price per yard $1.50. 

23. The cost of a piece of clotlr is $7.50 and the cost per yard is 
$1.50. How many yards are there in the piece? 

24. A woman paid $7.50 for a piece of silk that cost her $1.60 per 
yard. How many yards were there in the piece? 

26. A woman had $7.50 and bought silk at $1.60 a yard. How 
many yards did she buy? 

26. A quantity of silk at $1.60 per yard cost $7.60. What was the 
quantity? 

27. SUk is $1.50 a yard and I bought $7.60 worth to-day. How 
many yards did I buy? 

28. A woman’s bill for silk was $7.50. If each yard cost $1.60, 
how many yards were bought? 


This Ulustration of the variety of terms which are used in 
the statement of one problem becomes more significant 
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when we remember that this is just one problem and a rela¬ 
tively simple one. It should be clear that learning to read 
problems is not an easy matter. 

A test to measure a pupil’s knowledge of words used in 
problems. The test given below was devised to measure a 
pupil’s knowledge of the meaning of words used in stating 
problems. The words in this test were found to be “com¬ 
mon” to three or four of the newer textbooks for the grades 
in which the test was given. A preliminary test was given 
first to insure that the pupils would understand what the 
test asked them to do. 

VocABUiiABY Test m Arithmetic * 

Name..... Grade. 

1. Put w beside each word that tells what a man’s work is. 

2. Put m beside each word about money. 

8. Put Z beside each word that might be used about land. 

4. Put i beside each word that is the name of something to put 


things in. 




basin 

area 

merchant 

profit 

salary 

carpenter 

cashier 

pasture 

retail 

field 

building lot 

earn 

mason 

bin 

attend 

collect 

basket 

real estate 

teamster 

tank 

lot 

poultry 

jars 

acre 

bucket 

fares 

debts 

income 

rent 

dealer 

gardener 

insurance 

machinist 

tailor 

expenses 

miller 

coins 

barrel 

nickel 

cistern 

broker 

wages 

owe 

customer 

excavate 

Commission 

schedule 



In Table XVIII the per cent of pupils in both the fourth 
and fifth grades who failed to mark the words correctly is 
given. Thus, forty per cent of fourth-grade pupils and 

* Chase, Sara E., “Waste in Arithmetic,” Teachers College Record 
(September, 1017), vol. 18, p. 364. 
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Table XVIII. Showustg Per Cent of Failuees on Vocabxj- 
iiABT Test in Abithmetic 


/ 


basin. 

salary. 

retail. 

mason. 

basket. 

lot. 

bucket. 

tent... ... 
mnehinial,, 

coins. 

broker. 

excavate... 

area. 

carpenter,. 

field. 

bln. 

real estate. 
poultry.... 

fares. 

dealer. 

tailor. 

barrel. 

W.agcs. 

coinmission 


Grade 


Ch'ode 


D 


IV 

V 

26% 

20% 

merchant. 

45% 

24% 

40 

20 

cashier. 

62 

20 

so 

10 

building lot. 

66 

32 

78 

30 

attend. 

4 

4 

13 

3 

teamster. 

83 

40 

9 

12 

jars . 

40 

10 

30 

16 

debts. 

SI 

32 

60 

23 

gardener. 

17 

8 

86 

23 

expenses... .... 

65 

20 

20 

10 

nickel. 

13 

16 

50 

45 

o^e., 

91 

00 

4 

4 

schedule. 

17 

4 

01 

30 

profit. 

78 

45 

20 

8 

pasture. 

52 

32 

9 

8 

earn. 

60 

36 

43 

20 

collect. 

17 

8 

100 

C8 

tank. 

66 

30 

40 

30 

acre. 

60 

32 

66 

GO 

income 

96 

41 

35 

28 

insurance. 

91 

42 

13 

4 

miller.. . 

26 

12 

30 

32 

cistern........ 

100 

88 

70 

23 

customer. 

35 

44 

100 

03 





twenty per cent of fifth-grade pupils failed to mark “sal¬ 
ary" as a “word about money." All of the words in this 
list are not technical terms, but a number, such as “salary,” 
“rent,” “area,” “field,” and “bin,” are used in designating 
the relationship of quantities in problems. For example, 
“A man receives $185 per month. What is his yearly sal¬ 
ary?” or, “A house rents for $40 per month. How much is 
that a year? ” In the first problem a pupil cannot reason 
about the situation unless he knows that “salary” refers to 
the “$I85 per month*’ which the man receives. 
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In another test pupils were asked to draw the figures 
named in Table XIX. The numbers in the table are the 
per cent of pupils in each grade who failed to draw the cor¬ 
rect figure. 


TaeiiB XIX. Showtng Per Cent of Pupils vrao failed to draw 

CORRECTLY THE PlGDRES NaMED 


Grades 



III 

XV 

r 


10 

4 

8 


100 

S9 

SO 


50 

S'? 

20 i 


15 


Y 1 

4 1 


87 

68 

1 




These two simple tests show something of what the situ¬ 
ation in arithmetic probably is. We are asking pupils to 
solve problems when they do not know the meaning of the 
terms used in the problems. We must, therefore, begin to 
give explicit instruction in the meaning of technical terms. 

When a class is below standard in correct reasoning, one 
of two conditions exists. First is a case of ignorance; the 
pupils do not know the meaning of the technical terms or 
cannot recall the required principles and facts. The second 
may be the lack of knowing how to use this information or 
the lack of a sufficient motive. After examining the test 
papers of several thousand pupils, it is the writer’s judg¬ 
ment that the first is the more frequent condition, but often 
pupils fail to reason correctly in solving problems because 
they have no plan of thinking. We saw in the case of silent 
reading that one cause of poor comprehension was the fail- 
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ure to verify the meaning obtained. In solving problems 
pupils “accept” an incorrect solution because they do not 
verify their plan; that is, they omit the fourth step in the 
process as outlined on page 162. 

The general con-ectives are suggested by the above analy¬ 
sis. The pupils should be taught the arithmetical meaning 
of the technical terms used in stating problems. They 
should also be trained to have a good procedure, to be 
somewhat systematic in their reasoning. Especially should l 
emphasis be placed upon the step of verification. 

Type in. Below standard in calculation. These tests 
were not designed to measure ability to perform the opera¬ 
tions of arithmetic. For this reason too much importance 
should not be attached to the “correct answer” scores; but 
when these scores show a class to be conspicuously below 
standard in calculation, the pupils should be given one of 
the series of tests described in Chapter IV. If these tests 
show the class to be below standard, the correctives pre¬ 
scribed in Chapter V should be used. Only one point needs 
comment here. If a class is found to be up to or above stand¬ 
ard when tested on the operations separately, then the 
teacher has the problem of causing the pupils to use this 
ability in solving problems. Then the teacher should give 
less “isolated” drill — that is, drill upon examples — and 
more practice in the solving of problems. 

A frequent source of error is the copying of figures. Some 
pupils copy the wrong figures, as 86 for 65. Others write all 
numbers as dollars pointing off two places. Still others, 
when they wish to subtract 340 from 60000, write 

60000 

240 

Type IV. Scores widely scattered. As in silent reading 
and the operations of arithmetic, frequently the scores of a 
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class will be found widely scattered or distributed. Some 
pupils wiU have relatively high scores, others will have very 
low scores. The remedy is to give individual or group in¬ 
struction to those who have low scores. Those who have 
high scores also need special inslruciion. It may be that 
they should devote some of the time which they are now 
giving to the problems of arithmetic to some other subject. 
A few cases may be adjusted by a reclassification. The cor¬ 
rective instruction for those below standard can be best 
presented in connection with certain typical errors. 

Neglect of certain technical words. An examination of 
ninety-five fourth-grade test papers revealed the following 
solutions of this problem: “How much more is earned pmr 
day by a man receiving $30 per week than by a man re¬ 
ceiving $18 per week? ” 


Solutions correct in principle.23 pupils 

30 + 18 = 48. 15 “ 

30 - 18 = 12 38 “ 

30 X 18 = 540 . 4 “ 

30 - 18 = 22 2 " 

SO - 18 = 28 2 “ 

30 X 18 = 130 . 2 “ 

$3.00 and $5.00. 3 “ 

30 - 18 = 12/30 more . 2 “ 

3018 + 7 = 4148. 1 " 

30 + 10 = 40 1 “ 

30 X 18 =60.6. 1 “ 


The solutions “30 - 18 = 12,” “30 - 18 = 22.” and 
“30 — 18 = 28” indicate that the pupils neglected the 
technical phrase “per day.” If this phrase did not occur in 
the problem these solutions would be correct in principle. 
It might be that some of the pupils did not know the sig¬ 
nificance of this term. Solutions such as "30 -1- 18 = 48” 
and “30 X 18 = 540” indicate either a complete ignorance 
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of the technical term, “how much more,” or failure to 
reason at all. 

In the case of this problem, “A car contains 72,060 lbs. of 
wheat. How much is it worth at 87 cents a bushel?” many 
fifth-grade pupils gave no evidence that the number of 
pounds must be reduced to bushels. In the problem, “What 
are the average daily earnings of a boy who receives $0.88, 
$0.26, $1.15, $0.76, $0.50, and $0.60 in one week ?” a very 
large per cent of the pupils failed to pay attention to the 
word “average.” Its presence in the problem requii'es that 
the sum of the earnings be divided by 6. 

The corrective for the neglect of technical terms is to 
teach the pupils their meanings. In this case the pupils who 
simply subtracted 18 from 30 need to be taught that “how 
much per day” when the amount is given for tlie week 
means division by the number of days in the week. When 
pupils do not know the meaning of “average” they must 
be taught. 

Guessing instead of thinking. An excellent illustration of 
this type of procedure is given by Adams.' It occurred in an 
English school in what is the equivalent of our seventh 
grade. The problem, “If 7 and 2 make 10, what will 12 and 

6 make?” is not the sort which we are accustomed to, but 
this fact does not destroy the value of the illustration; 

A look of dismay passed over the seventy-odd faces as this ap¬ 
parently meaningless question Was read. Everybody knew that 

7 and 2 did n’t make 10, so that was nonsense. But even if it had 
been sense, what was the use of it? For everybody knew that 12 
and 6 make 18 — nobody needed the help of 7 and 2 to find that 
out, Nobody knew exactly how to treat this strange problem. 

Fat John Thomson, from the foot of the class, raised his hand, 
and when asked what he wanted, said: — 

“Please, sir, what rule is it?” 


* Adams, John, Eepontion and lUustraiion in Teaching, pp. 176-78. 
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Mr. Leckie smiled as he answered: — 

“You must find out for yourself, John; what rule do you think 
it is, nowP” 

But John had nothing to say to such foolishness. “What’s the 
use of giving a fellow a count* and not telling him the rule?”—■ 
that’s what John thought. But as it was a heinous sin in Standard 
VI [seventh grade] to have “nothing on your slate,” John pro¬ 
ceeded to put dovm various figures and dots, and then went on to 
divide and multiply them time about. 

He first multiplied 7 by 2 and got 14. Then, dividing by 10, 
he got 1 2/r. But he did n’t like the look of this. He hated frac¬ 
tions. Besides, he knew from bitter experience that whenever he 
had fractions in his answer he was wrong. 

So he multiplied 14 by 10 this time, and got 140, which certainly 
looked much better, and caused less trouble. 

He thought that 12 ought to come out of 140; they both looked 
nice, easy, good-natured numbers. But when he found that the 
answer was 11 and 8 over, he knew that he had not yet, hit upwn 
the right tack; for remainders are just as fatal in answers as frac¬ 
tions. At least, that was John’s experience. 

Accordingly, he rubbed out this false move into division, and 
fell back upwn multiplication. When he had multiplied 140 by 12, 
he found the answer 1680, which seemed to him a fine, big, sensible 
sort of answer. 

Then he began to wonder whether division was going to work 
this time. As he proceeded to divide by 6, his eyes gleamed with 
triumph. 

“Six into 48, 8 an’ nothin’ over, — 2 — 8 —^ 0 an’ no remainder. 
I’ve got it!” 

Here jx>or John fell back in his seat, folded his arms, and waited 
pmtiently till his less fortunate fellows had finished. 

James* knew from the “if” at the beginning of the question that 
it must be proportion; and since there were five terms, it must be 
compound proportion. That was all plain enough, so he started, 
following his rule: 

“If 7 gives 10, what will 2 give? — less.” 

Then he put down 

7; 2;; 10; 


* Scotch; any kind of arithmetical exercise in school work. 

* The clever boy of the class. 
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“Then if 12 gives 10, what will 6 give? — again less.” So he 
put down this time 

12:6 

Then he went on loyally to follow his rule: multiplied all the 
second and third terms together, and duly divided by the product 
of the first two terms. This gave the very unpromising answer 1 3 /7. 

He did not at all see how 12 and 6 could make 13/7. But that 
was n’t his lookout. Let the rule see to that. 

Alter examining a large number of test papers, this ac¬ 
count appears to the writer to describe the mental processes 
of a considerable number of pupils. They have not learned 
to think. The teacher insists that they “try” and they put 
down figures. They have been taught that it is worse to 
admit that they cannot solve a problem than to try it 
by unintelligent guessing. It seems that pupils should be 
taught to admit frankly that they do not know something 
when they don’t know rather than to try to “bluff.” 

The corrective. Pupils are frequently taught to solve by 
rule rather than to reason. Rules are helpful when used 
properly, but teachers should train pupils to think, to as¬ 
sociate definite meanings with technical terms, to combine 
these meanings and recalled rules into a plan of solution 
and to verify the proposed solution. To do this, the teacher 
should at first use simple problems, such as, “What is the 
area of a field 40 rods by 60 rods?” or, “WTiat is the cost 
of 15 cows at $60 apiece?” and explain to the pupils that 
the words, “What is the area,” “What is the cost,” to¬ 
gether with the form of the remainder of the statement of 
the problem, tell one what operation to perform. The words 
used in stating a problem when properly imderstood tell 
one what the plan of solution should be. Occasionally it is 
necessary to recall rules or principles, but these are sug¬ 
gested by the words of the problem. If this idea can be 
impressed upon a pupil, progress will have been made in 
teaching him to think. 
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Illustrations of failure to verify answer. Frequently pu¬ 
pils give answers which are absurd, thereby furnishing evi¬ 
dence of failing to apply even a common-sense check to their 
answers. Thefollowing are a few illustrations of this practice: 

Problem: “A baker used 3/5 lb. of flour to a loaf of bread. 
How many loaves could he make from a barrel (196 lbs.) of 
flour?” 

Solution: “3/5 of 196 lbs. = 117 S/S loaves.” This solu¬ 
tion was given by a large number of sixth- and seventh-grade 
pupils. One sixth-grade pupil gave this: “ 3/5 X 39 = 39 l/S 
loaves.” 

Problem: “ At the rate of $4 for an 8-hotu' day, how much 
is due a man for 6 l/2 hours work?” 

Solution (sixth grade): “13/2 X 4/l =$26.” This solu¬ 
tion was given by a considerable number of pupils. Some 
sixth-grade pupils gave this: “8 — 6 l/2 = $2 l/2.” One 
gave this, "6 X 4 = 34, 24 X 8 = $272 1/2.” 

The corrective. Some teachers recommend requiring pu¬ 
pils to estimate the answer before beginning the solution. 
For example, in the first problem above, the pupil could de¬ 
termine whether the number of loaves would be greater or 
less than the number of pounds of flour, 196. In the second 
problem, the pupil could determine whether a man would 
receive more or less for 6 l/2 hours than for 8 hours. This 
makes a common-sense verification a part of the solution 
of a problem. 

Other reasoning tests. Several other tests have been 
devised to measure the abilities of pupils to solve problems 
involving reasoning, but none of them have been widely 
used. Some years ago Stone^ worked out a reasoning test 

* Stone, C. W., Arilhmehcal Abilities and Some Factors Determining 
Them. Teachers College Contributions to Education, no. 19. (1008.) See 
also Stone, C. W., Standardized Reasoning 'Tests in Anthmetic and How to 
Utilize Them. Teachers College Contributions to Education, no, 83. (1016.) 
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which has been used in several cities, and in a number of city 
school surveys, so that we have rather definite standards 
as to what may be expected from its use. Starch has devised 
a test which is called Arithmetical Scale A.’ This scale in¬ 
cluded a number of the problems used by Stone, Courtis, 
and Thorndike. They have been evaluated upon the basis 
of difficulty and arranged in order of increasing difficulty. 
The pupils are allowed as much time as they need and a 
pupil’s score is the value of the most difficult problem done 
correctly. 


QUESTIONS AND TOPICS FOR STUDY 

1, What are the steps in the solving of a problem b arithmetic? 

2, To what extent and how is silent reading involved m solving problems? 

S. Why must the problems which ate used in a test be evaluated? 

4. How would you go about teaching a pupil to reason b solvbg prob¬ 
lems? 

5. How could you find out whether your pupils are lackmg b vocabulary 
or not? 

6. On page 160 why is the form of solution on the second test better than 
the form on the first? 

7. What reasons can you give for tlie absurd answers and forms of solu¬ 
tion which many pupils give to problems? How could you correct 
these defects? 


* Starch, Daniel, “A Scale for Mcasurbg Ability b Arithmetic"; b 
Journal of Edvoational Psychology, vol. 7, pp. 213Hi2. 




CHAPTER Vn 

THE MEASUREMENT OF ABILITY IN SPELLING ANR 
CORRECTIVE INSTRUCTION 

Making a spelling test. In order that the method of 
measuring ability in spelling may be understood, certain 
things in connection with the making of a spelling test must 
be explained. The following questions are some which must 
be considered: (1) What words should be selected for a test? 
(2) How difficult should the words be? (3) How many words 
should be used? (4) How should they be given? 

(i) Selection of words for a test on the basis of frequency 
of use. The English language contains many words. Some 
of these the average person never uses, others he uses only 
occasionally and a few he uses very frequently. For prac¬ 
tical purposes there is no advantage in one being able to 
spell words which he never uses, and the makers of courses 
of study and textbooks in spelling are attempting to elim¬ 
inate these words. Hence, it is obvious that such words 
should not be used to measure the ability of pupils to spell. 
Of the other two classes it is more important to be able to 
spell those words which are used most frequently, and for 
that reason they should be used in a spelling test if it is 
most helpful to the teacher. Hence, the first step in the selec¬ 
tion of words for a test is to determine what words are used 
most frequently in written language. 

Ayres’s determination of the most commonly used words. 
In determining the most commonly used words, the method 
employed has been to examine written material of several 
types, such as letters, newspapers, and children’s composi¬ 
tions, and to obtain a list of the words used and the number 
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of times each word occurs. Ayres ^ has combined the results 
of four such studies. Two of these studies were based on 
letters written, by adults, the third upon newspapers, and the 
fourth upon selections of standard literature. The mate¬ 
rial examined in the four studies aggregated 368,000 words, 
written by 2500 different persons. 

It was the original intention of Ayres to obtain a list of 
the two thousand most commonly used words, but this was 
impossible because the material examined was found to 
consist of a few words used many times, and of a larger num¬ 
ber of words used only a very few times. It was found that 
fifty different words were used so frequently that they made 
up approximately half of the material examined. In order 
to secure a list of the thousand most frequently used words, 
it was necessary to include words which were found only 
forty-four times in the 368,000 words of material examined. 
Other studies have been made to determine the words which 
are used most frequently in written language, but the re¬ 
sulting lists have not been arranged in a form which is con¬ 
venient to use for testing purposes. Hence, we shall limit 
this discussion of the measurement of spelling ability to the 
one thousand words of Ayres’s list which is published with 
the title A Measuring Scale for Ability in Spelling.^ How¬ 
ever, one other study may be mentioned to illustrate further 
this method of determining the words which should receive 
attention in teaching spelling and in the measurement of 
spelling ability. 

Jones’s list of words used by school-children. Jones 
collected compositions from pupils In Grades two to eight 
inclusive. In order that a record of the complete writing 

^ Ayrea, L. P., Measwement of Ahllity in, Spelling. Bulletin of the Divi¬ 
sion of Education, Russell Sage Foundation. (New York City, 1916.) 

‘ The reader should have a copy of this scale in order to properly under¬ 
stand this chapter. See Appendix for directions for ordering a sample 
package of tests. 
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vocabulary of each pupil might be obtained, a large number 
of compositions were written, the number per pupil ranging 
from 56 to 105. A total of 75,000 themes, consisting of a total 
of 15,000,000 words and written by 1050 pupils residing in 
four States, were examined. However, only 4532 different 
words were used by these pupils. Unfortunately, Jones does 
not tell us how many times each word was used so that we 
cannot obtain a list of the words which the children used 
most frequently. 

( 2 ) Determination of the difficulty of words. After we 
have a list of the most commonly used words, such as Ayres 
has given us, there remains the problem of determining the 
relative difficulty of the several words. It is a well-known 
fact that some words are more difficult to spell than others.'■ 
The words included in a test either must be equal in diffi¬ 
culty or their relative difficulties must be known. Otherwise 
we will be using a measiuing instrument consisting of un¬ 
equal units, but will be considering the units to be equal. 
Doing this makes our measurements inaccurate. The spell¬ 
ing difficulty of words for a given group of children may be 
determined by having the words spelled by them. From 
the per cent of correct spellings of each word the relative 
difficulty of the words may be calculated. Words which are 
misspelled an equal per cent of times by pupils of a given 
grade are equal in difficulty for that group. In the absence 
of this information it is practically impossible for a teacher 
to judge the difficulty of the words. Buckingham concluded 
that the judgment of a single teacher is almost of no value. 
“It may be good and it may be bad; and it is about as 
likely to be the one as the other.” 

^ The spelling difficulty of a vord has two iuterpretations. It may be 
taken to mean the difficulty which children have in learning to spell it. 
It may also refer to the frequency with which it is misspelled. The latter 
meaning will be used in this chapter. 
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How Ayres determined the difficulty of the words in his 
list. To determine the words of equal difficulty and the rela¬ 
tive difficulty of the groups of words, Ayres divided the 
thousand words into fifty lists of twenty words each. Each 
list of words was spelled by the children of two consecutive 
grades in a number of cities. The thousand words were 
then divided into another fifty lists of twenty words each. 
Each of the new lists was spelled by the children in four 
consecutive grades. In all, 70,000 children spelled twenty 
words, making a total of 1,400,000 spellings, or an average of 
fourteen hundred spellings of each of the thousand words. 

Upon the basis of this information Ayres classified the 
words into twenty-six groups, the words of each group being 
approximately equally difficult for school-children of a 
given grade. ^ This classified list, together with the per cent 
of pupils in each of the grades who spelled the words of each 
list correctly, has been printed with the title, Measuring 
Scale for Ability in Spelling. Strictly speaking, the Ayres 
Measuring Scale for Ability in Spelling is not a measuring 
instrument in itself, but rather a list of the foundation words 
of the English language, classified into twenty-six groups 
according to spelling difficulty. The teacher may use this 
list as a source of words for constructing spelling tests. 

Pupils are not tested when words are too easy. When a 
pupil spells correctly all of the words of a given list, we do 
not have a measure of his spelling ability. We simply 
know that he can spell these words correctly; we do not have 
any information concerning how far beyond this list his 
spelling ability extends. In fact, the pupil has been given no 
opportunity to show how well he can spell. It is a well- 
known fact that the pupils of any grade or of any class are 
not equal in ability, but exhibit a wide range of ability. 

‘ For the detaJs of the method employed flee Ayres, L. P., Measurement 
of Spelling AbUiiy, pp. 22-36. 
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Thus, in testing a class it is necessary to use words for which 
the average per cent of correct spellings is less than one hun¬ 
dred. Ayres recommends that in making a test for the 



Fio. 28. Showing the DiamiBurioN op 01 Pupils accobdinq to the 
Number op Words spbixed cohrecilt. 

CIa£3 averoge, 84 per cent. 


pupils of a given grade, the words be taken from the column 
for which an average of eighty-four per cent of correct 
spellings may be expected.* 

Pig. 28 represents a typical result of using the words 
chosen as Ayres recommends. Compare the shape of this 
distribution with the shape of Figs. 1 and 2. These fig- 

* The reader should not confuse scores or measures of ability with school 
marks. The per cent of correct spellings is a measure. The school mark is 
the meaning which the school attaches to that measure. The fact that both 
the measure and the school mark may be expressed in per cents does not 
make them the same. 
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ures were presented as evidence that teachers’ marks were 
inaccurate. The class average is eighty-four per cent, but 
those pupils who spelled all of the words correctly have not 
been tested. Those who misspelled only one or two words 
probably have not been tested satisfactorily. 

OUs^ presents facts from which he concludes that the most 
reliable measures of spelling ability are obtained by using 
words for which there is an average of fifty per cent of cor¬ 
rect spellings. In support of this conclusion he points out 
that a list of words for which the average per cent of correct 
spellings was either zero per cent or one hundred per cent, 
would yield a measure of zero reliability. Likewise a list of 
words for which the average per cent of correct spellings 
was ten per cent or ninety per cent, would yield measures 
only slightly more reliable. Hence, it seems natural that 
the most reliable measures would be obtained by using a 
list for which the average per cent of correct spellings was 
fifty. On the other hand, some writers claim that it is not 
wise to have pupils spell words incorrectly. They point out 
that every repetibion tends to fix a habit. 

Ayres gives no satisfactory justification for recommend¬ 
ing the choice of words for which an average of eighty-four 
per cent of correct spellings may be expected. When meas¬ 
uring the spelling ability of children in Springfield, Illinois, 
Ayres used words for which seventy per cent of correct 
spellings had been obtained. For the Survey of Cleveland, 
Ohio, the words were chosen from columns for which the 
average per cent of correct spellings was seventy-three. 
Thorndike has used words for which the per cent of cor¬ 
rect spelling is fifty,” For these reasons it is probably best 

^ Otia, A. S., "The Reliability of Spelling Scales”; in School and So¬ 
ciety, vol 4, p, 753, 

” Thorndike, E. L., "Meanaof Measuring School Achievement in Spell¬ 
ing”; in Educational Adminieiraiion and Supervision, vol, 1, p. 306. 
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to choose words from columns for which the average per 
cent of correct spellings is approximately seventy. 

( 3 ) How many words to use. Another question which 
must be considered in making a spelling test is the number 
of words it is necessary to use. In general the ability to spell 
one word is separate and distinct from the ability to spell 
any other word. Ability to spell, therefore, consists of a large 
number of abilities to spell specific words. This being the 
case it would be necessary to use all of the thousand words 
of Ayres’s list in order to obtain a complete and accurate 
measure of a pupil’s ability to spell the most commonly 
used words. However, it is possible to secure a measure 
which is representative of the pupil’s ability to spell these 
words by using a smaller number of words. This is possible 
in just the same way that it is possible to determine the 
quality of a load of wheat or a vat of cream by the examina¬ 
tion of a sample. 

How many words are necessary in making a spelling test 
depends upon what is desired. Belying upon the theory of 
random sampling, Thorndike believes a small number of 
words is sufficient to measure the spelling achievement of a 
large school system. A test consisting of only ten words has 
been used in a number of school surveys. This number is 
probably sufficient for the measure of a large school system, 
but if it is desired to obtain a measme of the spelling ability 
of individual pupils, a larger number must be used. Otis* 
says that a twenty-five-word test gives a very poor measure 
of individual ability, and that at least one hundred words 
should be used, better four hundred or five hundred words. 
Starch recommends the use of two hundred words. There¬ 
fore, it is probably best to use as large a list of words as the 
time which the teacher can use for measuring spelling will 
permit. At least fifty words should be used if possible. 

* Loc. oit,, pp. 679, 682. 
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( 4 ) How should the words be given. The complaint is 
frequently made that pupils spell words correctly in the 
spelling class, but misspell the same words when writing 
compositions and other school exercises. One reason why 
this occurs is that in the spelling class the pupil has his atten¬ 
tion fixed upon the spelling of the word and takes time to do 
his best. In writing a composition, his attention must be 
centered upon what he is writing, and thus he is able to give 
only partial attention to the spelling. Also he probably 
writes more rapidly. Hence, we may recognize two types of 
spelling ability; ( 1 ) the ability to spell words when one’s 
attention is focused upon the spelling; ( 2 ) the ability to 
spell words when one’s attention is focused upon other things 
and the spelling is carried on in the margin of consciousness. 

The words which make up a test may be dictated to the 
pupils as separate words, or they may be embedded in sen¬ 
tences which are dictated. Furthermore, the dictation of the 
sentences may be timed so that the pupils are forced to write 
at their normal rate. In this way we are able to secure ap¬ 
proximately the second type of spelling. Investigation has 
shown that the per cent of correct spellings is higher when 
the words are dictated separately than when they are dic¬ 
tated in timed sentences and the pupils are forced to write 
at their normal rate. According to Courtis the per cent of 
correct spellings is about five greater when the words are 
dictated in lists. Fordyce has found this difference to be 
between ten and fifteen per cent. The writer has found a 
difference of more than six per cent. 

In writing letters, compositions, and the like, the spelling 
must be carried on in the margin of the attention because 
the ideas which are being expressed must occupy the focus 
of the attention. This is particularly true of the foundation 
words of the language such as we have in the Ayres list. 
The words of this list constitute over ninety per cent of the 
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words we use. Hence, by using the words embedded in sen¬ 
tences and dictated rapidly enough to force the child to 
write at his normal rate, we measure the spelling ability 
which functions in one’s every-day writing. 

The rate of dictation. Pupils may be caused to write at 
approximately their normal rate by dictating the sentences 
at that rate. The Freeman’s standards for rate of handwrit¬ 
ing are as follows in terms of letters per minute: second 
grade, 36 letters; third grade, 48 letters; fourth gi-ade, 56 
letters; fifth grade, 63 letters; sixth grade, 72 letters; sev¬ 
enth grade, 80 letters; eighth grade, 90 letters. The dicta¬ 
tion of a sentence requires some additional time, probably 
ten per cent. For example, in the case of the sixth grade, 
instead of dictating at the rate of 72 letters in one minute, 
60 seconds should be allowed for words totaling 72 letters. 
On this basis the number of seconds to be allowed per letter 
for the several grades are as follows: — 


Grade Seconds per letter 

n . 1 . 8 S 

in .1,38 

IV . 1.18 

V . 1,01 

VI .92 

vn .83 

Vin .73 


If the sentences contain more than thirty to forty letters, 
they should be dictated in sections, so that the pupil’s writ¬ 
ing will not be slowed up by trying to recall what has been 
dictated. Furthermore, tests of rate in handwriting have 
shown that all pupils do not normally write at the same rate. 
For this reason provision must be made for those pupUs 
who are accustomed to write more slowly than the standard 
rate. This can be done by having none of the test words 
come at the end of the sentences, and requiring all pupils to 
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begin, upon tbe next sentence as soon as it is dictated, even 
if they have not finished writing the preceding. 

Siunmaty; The discussion of the making of a spelling test 
may be summarized as follows: 

1. The Ayres Measuring Scale for Ability in Spelling is 
a list of the one thousand most commonly used words of the 
English language. These words have been classified accord¬ 
ing to difficulty and words chosen from one column may be 
considered as being equally difficult. When words are taken 
from more than one column the inequality of difficulty must 
be recognized, if an accurate measm'e is to be secured. 

2. Twenty words are probably sufficient to secure a reli¬ 
able measure of the spelling ability of a class. At least fifty 
words should be used to secure a reliable measure of the 
spelling ability of individual pupils. More accurate meas¬ 
ures will be obtained by using one hundred words. In the 
case of the upper grades it will be necessary to use words 
from more than one column. When this is done the relative 
difficulty of the words must be recognized to secure an accu¬ 
rate measure. 

S. In order that the words may be difficult enough to 
really measure the spelling ability of all pupils, the words 
should be chosen from columns for which the standard per 
cent of correct spellings is approximately seventy. For the 
lower grades it is probably best to use words for which the 
standard per cent of correct spellings is from fifty to sixty- 
six. If the words are to be used in timed sentences it will 
probably be satisfactory to use easier words. 

4. In order to secure the best measurement of spelling 
ability, the words should be embedded in sentences, and the 
sentences dictated at approximately the standard rate of 
handwriting for the grade. Test words should not occiu at 
the end of the sentences. 

A timed sentence spelling test. In order to illustrate the 
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type of test described above, -we reproduce the directions 
and a test arranged for the fourth grade. The rate of dicta¬ 
tion of this test was determined upon the basis of measure¬ 
ments of the handwriting rate of six thousand Kansas 
school-children. 

Directions for Giving a Timed-Sbntbncb Test 

1. See that the pupils are provided with two or three sheets of 
paper and with either pencil or pen and ink. If pencils are to be 
used they should be well sharpened. If pen and ink are used, 
good pens should he provided. 

2. Make certain that all pupils understand what they are to 
do. It is well to give a short preliminary practice in writing from 
dictation if the pupils are not accustomed to it. For this purpose 
use some simple selection. 

3. It is well not to tell the pupils that they are being tested in 
spelling, Under no circumstances indicate the test words by 
emphasis in dictating. 

4. ‘When, everything is ready, say to the pupils: “I have some 
sentences which I want you to write as I dictate them. I am 
going to dictate them rather rapidly, possibly more rapidly than 
Some of you can write. If you have not finished writing one sen¬ 
tence when I begin to dictate another, I want you to leave it and 
begin on the new sentence. If there are any words you cannot 
spell, you may omit them. Take time to dot your i’s and cross your 
t’s. If you have any question about what you are to do, ask it 
now, because you cannot ask questions after I begin to dictate.” 

6. Use the arrangement of the sentences which has been pre¬ 
pared for the grade you are testing. If a teacher has two divisions 
of different grades, as SB and 6A, she must test the two divisions 
separately, using the test which is arranged for each grade. When 
the second hand of your watch is at 60 read the first sentence. 
When the second hand reaches the next number printed in the 
margin, read the second sentence. Dictate the other sentences 
at the time indicated. Dictate the sentences distinctly, but do 
not repeat. Be careful not to suggest the spelling of the words by 
unduly emphasizing certain syllables. It is advisable for the 
teacher to practice dictatmg the sentences according to the direc¬ 
tions before attempting it with a class. 
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6, Stop the pupils promptly at the time indicated. Allow no 
corrections at additions to be made. Ask the pupils to turn their 
papers over and write their name and grade. Appoint two or 
three pupils to collect the papers. 

A Timed-Sentbnob Test abbaitged fob the Fotjbth Grade 

Test words taken from column M of the Ayres Scale 

' Seconds 

60 He bought a railroad tickd to the city. 

41 Collect the account before Sunday. 

18 Those children will return soon. 

63 Anyway she is ready to go. 

19 Please omit both names. 

44 Few change trains here. 

9 He says the great office is full. 

43 Who died this morning? 

6 The money for the ■picture was paid to us.' 

47 The members did not understand him. 

34 Again he took the car. 

46 It will provide an income in his old age. 

37 The army had begun to drill in the park. 

7 He might begin the contract next week. 

47 I was unable to recover the bill. 

31 I have an extra dress with me. 

61 The deal was almost closed. 

19 Did you inform him follow the car? ' 

56 The -past month I was in the south. 

80 While he goes home, you stay. 

68 The car was driven beside the train. 

85 I saw him enter the place. 

When the second hand reaches 1, stop the writing. 

Allow no corrections or additions to be made. Ask the pupils to 
turn their papers over and write their name and grade. Appoint 
two OP three pupils to collect the papers. 

Marking the test papers. The most accurate results will 
be obtained when the teacher marks the test papers for 
incorrect spellings and omissions of test words, but unless 
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the teacher has sufficient time for this work the papers may 
be marked by the pupils. When this plan is followed the 
teacher should speU out the test words and have the pupils 
mark with a cross words misspelled and words omitted. 
(When a timed-sentence test is used no attention is given 
to words which are not test words.) The number of test 
words correctly spelled should be written at the top of each 
pupil’s paper. This is the pupil’s score. By dividing the 
number of words spelled correctly by the number in the 
test, the per cent correct is obtained. 

Recording the scores. For recording the scores of a class 
a record sheet such as shown in Fig. 29 should be used. 
(This record sheet is used for a fifty-word test.) In this way 
the teacher obtains a statement of the number of pu^ls who 
spelled forty words correctly, the number who spelled forty- 
one words correctly, etc. The class score may be found by 
adding the scores of all of the pupils together and dividing 
this sum by the number of pupils. This quotient is the aver¬ 
age, For practical purposes it is just as satisfactory and 
more convenient to find the median. This may be done by 
arranging the test papers in the order of the number of 
words spelled correctly, the lowest score on the bottom. 
The score on the middle paper is the median score. 

Standards: (1) The Ayres Scale. In classifying the words 
of his list according to difficulty, Ayres determined the 
average per cent of the pupils of each grade who spelled the 
words correctly. Thus the words of column O were spelled 
correctly by 60 per cent of the third-grade pupils, 73 per 
cent of the fourth-grade pupils, 84 per cent of the fifth-grade 
pupils, 92 per cent of the sixth-grade pupils, 96 per cent of 
the seventh-grade pupils, and 99 per cent of the eighth- 
grade pupils. These per cents, which are printed at the head 
of each column, represent the average spelling ability of 
pupils in the several grades when the words are dictated in 
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Distribution of Pupils* Scores 


Niimboi* of -words 
spoiled Qorreotlir 

Numbor of pupils 

Numbor of words 
Spoiled correotlj' 

Number of pupils 

50 


Sub* Total 


49 


24 


43 


23 


17 


22 


46 


21 


IS 


20 


44 


19 


13 


18 


42 


17 


41 


16 


40 


15 


89 


14 


38 


13 


37 


12 


36 
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36 
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38 
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Fiq. 29 , Showing thh Eecobd Shbhi; for recording Pdpilb’ Scores 
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lists. When the words are used in timed sentences the aver¬ 
ages have been 5 to 15 per cent lower. 

It may be seriously questioned whether the averages 
which Ayres gives are satisfactory standards of spelling 
ability for the foundation words of the language. Ayres 
says: “Probably the scale will have served its greatest use¬ 
fulness in any locality when the school-children have mas¬ 
tered these one thousand words so thoroughly that the scale 
has become quite useless as a measuring instrument.” In 
the past we have not had the advantage of such a list and 
have distributed our efforts in teaching spelling over a very 
much larger list of words. If we accept these one thousand 
words as the foundation words of our language, we should 
place prime emphasis upon teaching them.' This being the 
case a satisfactory eighth-grade standard would approxi¬ 
mate one hundred per cent for all of the words. For the pre¬ 
ceding grades the standard would be one himdred per cent 
for the words of the list which the pupils had been taught. 
For example, the easiest nine hundred words might be used 
for the seventh grade, the easiest seven hundred and fifty 
for the sixth grade, and so forth. The use of the scale in the 
way Ayres suggests would seem to lead to standards of this 
type. The distribution of the words among the several 
grades and the optimum standards must be determined by 
experimentation. 

(2) Timed-sentence spelling tests, A series of timed-sen¬ 
tence spelling tests similar to the one reproduced on page 
186 was given to several thousand children in Kansas about 
the seventh month of the school year. The median scores 
are given in Table XX, and they may be used as tentative 
standards for timed-sentence spelling tests of the type re¬ 
produced on page 186, but it must be remembered that as 
we improve our teaching of spelling our standards should be 
raised. 
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Table XX. Showing Median Scores fob a Timed-Sbntench 
Spelling Test op FiPTr Words 


Orach 

1 

Nvniber of 
pupils tested 

Median seores. 
Number of 
words spelled 
eorreoily 

Per cent of 
words spelled 
coireclly 

AyresU stand¬ 
ards 

in. 

097 

28 

66 

66 

IV. 

loco 

30 

78 

84 

V. 

1009 

33 

66 

73 

VI. 

870 

40 

80 

84 

Vll. 

826 

SS 

70 


vm. 

608 

42 

84 

88* 


* Tbc test for th6 aeveoth and eigbtb grades consisted of words tAkcn from three coU 
limns. Hence these standards ore only approxjmate. 


Causes of low class scores. As in the case of other sub¬ 
jects the teacher should use the results of spelling tests as a 
basis for planning instruction which will correct the defects 
that the tests reveal. A class score below standard indi¬ 
cates an unsatisfactory condition which may be due to one 
or more of the following conditions: 

1. The class as a whole may be unable to spell certain 
words. 

2. Certain pupils may be unable to spell a large number 
of the words of the test. 

8. The errors may be rather uniformly distributed as to 
both words and pupils. 

To determine the extent to which each condition causes 
the low class average, the teacher should make the follow¬ 
ing type of tabulation from the test papers. This will 
give a record of each pupil for each word of the test. In¬ 
stead of designating the pupil by number as in this illustra¬ 
tion their names or initials can be used at the head of the 
columns. 

















ABILITY IN SPELLING 


191 



Although, these words are listed by Ayres in his Spelling 
Scale as being equally difficult for pupils in general, they 
are not necessarily so for particular pupils. Obviously in 
the class here represented "catch” and “clothing” need 
general emphasis, while only certain pupils need to give 
attention to “black,” “began,” and “unless.” Pupil 11 has 
misspelled five out of six words, and hence probably Is a 
“poor speller.” 

What a spelling test reveals. Such a tabulation of the 
results of a test is valuable because it reveals the character 
of the spelling ability of the class. It points out the “poor 
spellers.” It indicates whether the class as a whole find some 
words difficult to spell or the misspellings are uniformly dis¬ 
tributed. However, it must be remembered that the test 
contains only a limited number of words, and although the 
results may be accepted as indicating the nature of the con¬ 
ditions which exist, it cannot tell the teacher all the words 
for which corrective instruction must be planned. Simply 
to know that a pupil is below standard in ability is of little 
value to the teacher, because in general the ability to spell 
one word does not imply ability to spell another word, nor 
does the lack of ability to spell a given word indicate that a 
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pupil cannot spell another word. But the fact in the above 
illustration that most of the class could not spell correctly 
“catch” and “clothing” indicates that there are several 
words which the class as a whole do not know how to spell. 
On these words class instruction is needed. When the 
teacher knows the type of situation with which he has to 
deal he should then proceed to determine the particular 
words which all or certain pupils need to learn to spell. At 
least the teacher should make a very careful diagnosis of the 
spelling ability of each pupil whose test score is below stand¬ 
ard, to ascertain just what words he cannot spell of those 
he is expected to spell. 

This is accomplished by giving the pupils below standard 
a test including all of the words which they are expected to 
be able to spell. Such a test is not for the purpose of meas¬ 
urement, but should be thought of as the first step in the 
teaching of spelling. Each pupU should be required to make 
from this test a list of all the words which he has spelled 
incorrectly. The words of this list are the ones he needs to 
study. It is obvious that to ask a pupil to study words 
which he can already spell correctly is to ask him to use his 
time without profit. 

Class correctives. ** Spelling Demons.” Certain fre¬ 
quently used words are very frequently misspelled. Jones^ 
has given us a list of one hundred words which he found 
misspelled most frequently in children’s compositions. He 
calls them the “One hundred spelling demons of the English 
language.” Nine tenths of these words are found in Jones’s 
list for the second and third grades. Pour fifths of these words 
are found in Ayres’s list. Because these words are frequently 
misspelled and are among the commonly used words of the 
language a teacher will make no mistake in emphasizing 
these words in the teaching of spelling until the pupils can 
spell them correctly. 

1 Sea pages VI6-T! for a description of Jones’s study. 
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The One Htindeed Spelling Demons oe the English Language 


which 

can’t 

guess 

they 

their 

sure 

says 

half 

there 

loose 

having 

break 

separate 

lose 

just 

buy 

don't 

Wednesday 

doctor 

again 

meant 

country 

whether 

very 

business 

February 

believe 

none 

many 

know 

knew 

week 

friend 

could 

laid 

often 

some 

seems 

tear 

whole 

been 

Tuesday 

choose 

won’t 

since 

wear 

tired 

cough 

used 

answer 

grammar 

piece 

always 

two 

minute 

raise 

where 

too 

any 

ache 

women 

ready 

much 

read 

done 

forty 

beginning 

said 

hear 

hour 

blue 

hoarse 

here 

trouble 

though 

shoes 

write 

among 

coming 

to-night 

writing 

busy 

early 

wrote 

heard 

built 

instead 

enough 

does 

color 

easy 

truly 

once 

making 

through 

sugar 

would 

dear 

every 

straight 


Class drill. Courtis 1 recommends a form of class drill 
which may be used when the class as a whole are learn¬ 
ing to spell a word: 

The word to be learned is pronounced by the teacher and class 
together and then written letter by letter as it is spelled aloud. 
This is repeated five or six times in rapid succession. The rate of 
writing should be slow at first, then faster and faster (like a college 
yell), until at the sixth repetition only the most rapid writers are 
able to keep up with the class. 

spelling games. In the manual referred to above, Courtis 
describes the following games which may be used for pro- 

*■ Courtis, S. A., Teaching Spelling by Plays and Games (82 Eliot Street, 
Detroit. Michigan), p. 8. This is an excellent manual for teachers. It con¬ 
tains explicit directions for a number of spelling games. 
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viding drill upon spelling. They are particularly helpful 
when a stronger motive is needed. Each of these games pro¬ 
vides for dividing the pupils in a room into two teams or 
groups and for keeping scores for a week or a month: 

1. Syllable game. 

2. Jumbled-letter game. 

3. Initial game. 

4. Rhyming game. 

5. Derivative gome. 

6. Definition game. 

7. Linked-word game. 

8. Missing-word game. 

9. Composition game. 

Individual correctives- Types of misspellings. A pupil’s 
spelling difficulty is not completely diagnosed when the 
words he does not spell correctly are located. Errors in 
spelling are seldom if ever distributed uniformly among the 
several letters composing the word. Neither does it appear 
that there is much uniformity in the location of errors in 
different words. Certain words are misspelled in only a few 
ways, while other words are misspelled in many ways. 
Certain misspellings occur frequently, while others seldom 
occur. In Table XXI the misspellings of certain words found 
in the papers of eighty seventh-grade pupils are given, 
together with the frequency of each. The words were taken 
from column S of the Ayres Scale. "Where no number fol¬ 
lows the word that type of misspelling of the word occurred 
but once.i 

Causes of some misspellings. A study of Table XXI 
shows that certain forms of misspelling occur more fre¬ 
quently than others, and that most of the misspellings may 
be attributed to certain specific causes. Forms of misspell- 

* See also Sears, J. B., Spelling Effiaiency in the Oakland SehooU. Board 
of Education Bulletin, Oakland, Catifornia, p. 61. 
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Tabus XXI. The Misspbllino op Eighty Sbvhnth-Ghade 
Pupils on a Column Spelling Test 


I. affair 

govament 

XIV. particular 

affcro 

govemcment 

particuliar 

a{Ere 

gorvement 

pnrticuler 

ofair (d) 

Vn. improvement 

partictulcr, 

aff aired 

improvmcnt (7) 

perticular (8) 

' affer 

ioapovement 

particiar 

III oosist 

Vm. investigate 

pertuculoi 

ossit (3) 

investagate (3) 

partcular 

fliafit (2) ’ 

envesigadge 

partiular 

Qsciat 

inveatit^ 

partular 

Basest 

IX. marriage 

paticular 

ossaiat 

marrege (3) 

perciluar 

asscest 

marage 

pectuliar 

ossioat 

meniage 

pccticular 

acaiat 

Xi mention 

perticturol 

aciat (2) 

mensioQ (8) 

patuclure 

Bcciated 

mensioned 

peculiar 

ossaDtant 

mcantJon (2) 

pectulair 

ossised 

menohion 

XV. possible 

acceasesB 

XI. motion 

possaWe (4) 

acccat 

mosben 

posible 

oatist 

motieem 

posable 

Basis 

motatioa 

poaiable (2) 

AfisitQ 

mention 

poesiable (5) 

nil certain 

XH. neither 

poaobile 

certion (7) 

neatber (0) 

poBsibbo 

aertcn 

nether 

posiple 

sertoia 

niether (2) 

XVI. serious 

ccrtia 

nieghter 

cyreauB 

secrtaiD 

XHL opinion 

cernous 

rV. difference 

oppiuion { 5 ) 

Bcenous 

difference (10) 

opmon (2) 

serrious (S) 

difHerence 

opinton 

cerious 

examiDation 

oppoinca 

sereaus 

exametion (10) 

oppinum 

XVIIi stopped 

ezanution 

oppemon (2) 

sloped (13) 

ezamnitioQ 

opion (9) 

stopts 

ezcBinatioo 

oponioD (2) 

stocted 

excanittona 

oppion (2) 

stop 

esameDnUoQ (9) 

oinnnion 


VI. government 

opoln (2) 


govermeot (0) 

opionion 



ing sucli as “partiiilar,” “paxtuler,” “’opinon,” “impove- 
ment,” “possibbe,” are probably due to carelessness or ac¬ 
cident, “ a slip of the pen.” Relatively few of the misspell¬ 
ings in this table may be assigned to this cause. Errors of 
this type probably cannot be entirely eliminated from un- 
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corrected manuscript. However, drill will reduce the num¬ 
ber of such errors to a satisfactory minimum.* 

An important source of error is mispronunciation of the 
word by the pupil. He may have acquired this from the 
teacher, but more likely from those with whom he associates 
outside of school. Or it may have been acquired from lack 
of attention to the form of the word. Such misspellings as 
the following are probably caused by mispronunciation: 
“perticular,” “particlar.” “investagate,” “goverment,” 
“examation.” 

A very striking instance of this type of spelling error and 
its cause came to the attention of the writer a few years ago. 
A man who had taught geometry for a number of years 
used the word “frustum” in a manuscript, spelling it “frus- 
truro” which agreed with his pronunciation of the word. 
This manuscript was read by a number of well-known 
mathematicians who read it critically. Only two noted the 
misspelling of the word, and one mathematician, who took 
much pride in his ability to spell correctly and who was the 
author of several textbooks, admitted that he had always 
pronounced and speUed the word “frustrum.” 

Other errors listed in Table XXI are due to certain phonic 
irregularities of the English language, for example, certain 
misspellings of "assist,” “certain,” “affair,” “marriage,” 
“motion,” “neither,” and “serious.” Such errors occur 
more frequently in connection with vowels than with con¬ 
sonants. Still other errors, such as “ stoped,” and "improve¬ 
ment,” are due to certain doubled or silent letters. 

The length of words and the position of the letters are 
responsible for some errors. In general there is a close agree¬ 
ment between the number of letters in a word and its rela- 

1 Errors of this type have been called “ lapses ” See HollingTvorth, 
Leta S., Tke Psyoliology of Spetnal DisabUUy in SpeUing, Teachers College, 
Columbia University, Contributions to Education, no. 83. p. 38, for a com¬ 
plete statement of types. 
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tive difficulty. The longer the word, the more difficult it ia 
to spell. In Table XXI it is obvious that the errors are not 
uniformly distributed among the several letters of a word. 
For example, consider “examination,” the fifth word in the 
table. The letters e-x and t-i-o-n were given correctly in 
every case. The first a also occurs. In every case except 
one, the letter m is given. Fifteen out of the seventeen 
errors occur in connection with three letters, i-n-a. The 
explanation of this condition, which is typical, is that correct 
spelling “depends mainly upon a correct visual or audile 
image coordinated with the correct motor control.” * 
Some letters are more conspicuous than others in the form 
of the printed, or written, word and also in the sound of 
the spoken word. In general, the letters occupying the 
initial positions are remembered best for this reason. 

Some words are spelled incorrectly because the pupil has 
not learned any spelling, correct or incorrect, for the word. 
In such cases if the pupil is asked to spell the same word 
several times, different spellings will be given. HoUing- 
worth gives an illustration of this type. One pupil mis¬ 
spelled “saucer” in seven different ways in nine successive 
writings of the word: “s-a-u-e-c,” “s-u-s-s-e,” “s-u-c-c-e-r,” 
“s-u-c-c-e-r-e,” “s-u-r-r-e-s,” “s-u-s-s-e-r,” “s-u-c-e,” 

“s-u-s-s-e-r,” “s-u-c-c-e-r.” Other words are misspelled 
because the pupil has learned an incorrect spelling. This 
was the case in the misspelling of “frustum” described 
above. 

Still another cause of misspelling is a lack of the knowledge 
of the meaning of the word. Hohmgworth states: ^ 

On the basis of these data we conclude that knowledge of meaning 
is probably in and of itself an important determinant of error in 

1 Kallom, Arthur "W., “Some Causes of Misspellings”; in Journal of 
Educational Psychology, vol. 8, p. 395. 

® Psychology of Special Disability in Spelling, p. 57. 
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spelling; that children wUl produce about sixty-six and two-thirds 
per cent more of misspellings in writing words of the meanings of 
which they are ignorant or uncertain, than they will produce in writing 
words the meaning of which they Icnow. 

Teaching the pupil to correct his errors in spelling. 
Spelling consists in forming correct and fixed associations 
“between the successive letters of a word and between the 
word thus spelled and the meaning.” ^ The laws governing 
the formation of fixed associations are those of habit forma¬ 
tion. The first step in habit formation is to get the atten¬ 
tion of the child focused upon the associations to be formed. 
The second step is to secure sufficient repetition. Repetition 
of the associations is secured both through drill and through 
using the word in written expression. The pupil must give 
attention to the repetitions of the associations in order to 
insure that wrong associations will not be made. 

The causes of misspelling given above suggest certain 
correctives. If the error is due to an incorrect pronuncia¬ 
tion of the word, the pupil should be taught the correct 
prommciation. The phonic irregularities of words should 
be emphasized. In the case of long words the pupil’s atten¬ 
tion should be directed to the letters in the middle of the 
word. The meaning of the word should be connected with 
the pupil’s experience. This does not mean merely requiring 
him to use it in a sentence. 

As in the case of other school subjects motive is an im¬ 
portant factor in learning to spell. A strong motive can be 
secured by the use of standardized spelling tests. Definite 
standards should be set and at intervals careful tests should 
be made. Charts showing the scores of the individual pupils 
as well as the class score in comparison with the standard 
will be helpful. 


* Freeman, F. N., Psychology of the Common Branches, p. 116. 
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Numerous experiments have shown that pupils can spell 
correctly a large per cent of the words in the lists in spellers 
before they have studied them. Because of this fact the 
assignment of the spelling lesson should include the dicta¬ 
tion of the words to the pupils so that each might know what 
words he needed to study. The teacher would also learn 
what words he should emphasize in his instruction. 

Some writers state that a pupil should not be permitted 
to spell a word incorrectly when it can he avoided, and for 
this reason pupils should learn to spell words correctly be¬ 
fore they are required to write them. Just how important 
it is to do this we do not know. In certain cases it appears 
that a child or an adult learns to spell certain words cor¬ 
rectly by having his attention directed to his errors. The 
fact of his error serves to direct his attention to learning to 
spell the word correctly. Those who believe that evil effects 
will come from having pupils write words which they caimot 
spell correctly, may direct them to omit those words which 
they think they cannot spell correctly. 

The dictation of the words in assigning the spelling lesson, 
together with the detailed testing of the pupils as suggested 
on page 191, reveals to the teacher the words upon which 
he must exercise his ability as a teacher of spelhng. It also 
reveals to him the pupils to whom instruction should be 
directed in the case of each word. Particular methods and 
devices by means of which the laws of habit formation may 
be fulfilled are described in books which deal with the 
teaching of spelling.* 

A device for focusing attention upon the difiicult portion 
of a word. In teaching the spelling of a word the child’s 
attention should be directed to the crucial associations. 
If the word is one like “government,” his attention should 

* A very good chapter (vi) will be found in Freeman’s Psychology of the 
Common Branches. See also Cook and O'Shea, The Child arid his SpeUing. 
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be called to the correct pronunciation. If it is such a word 
as “their,” his attention should be called to the use of the 
word. To eliminate spelling errors a pupiTs attention 
should be called to hia particular error and he should be 
helped to remove the cause. If the cause is mispronuncia¬ 
tion, see that he learns to pronounce the word correctly. If 
the error is due to a confusion of letters, the pupil should be 
given some device to prevent this confusion. The following 
is a device which may be used for especially difficult words: 

Par-tio-Vrlar 

I frequently misspell.in writing compositions but now 

I am going to leam to spell it correctly. My teacher tells me that 

I do not look at the ...syllables and letters closely enough. 

I am going to do it now with.care. I see that the word 

has.syllables. The first syllable is.The vowel 

of this syllable is.. the fest letter of the alphabet. The 

last syllable is.and the vowel is also. The 

word contains.letters, the other vowels are. 

and. Now that I have looked at the word carefully I 

am going to be very.in spelling it. I am also going to be 

. in pronouncing it. I am going to remember that the 

vowel in the first syllable and in the last syllable is an. 

I am not going to pronounce those syllables as if the vowel were e 

instead of.lam going to be very.about both 

spelling and pronouncing this word. I want it to be correct in 
every. 

This device is used by providing the pupil who needs 
instruction with a printed or typewritten copy. The pupil 
is required to fill in the blank spaces correctly. This is re¬ 
peated until the correct associations are fixed. 

Drill for making associations automatic. Getting the 
pupil to spell a word correctly is only the first step. There 
must be attentive repetitions of the correct associations 
until they have become automatic. In this respect spelling 
is similar to arithmetic. In the teaching of the operations 
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of arithmetic, drill occupies a promment place, but in the 
case of spelling our teaching has been confined primarily to 
testing pupils. Requiring pupils to write each misspelled 
word ten or twenty times is an effort to provide practice. 
Such practice is unsatisfactory. After the first writing of the 
word the pupil probably copies. Hence the repetitions are 
not attentive. 

Practice upon words which are misspelled by a majority 
of the pupils can be secured by having them recur in the 
spelling lesson from day to day. This plan provides the 
same driU for all pupils regardless of whether they misspell 
the word or not. In this respect it is unsatisfactory. The 
pupils may be required to write material which the teacher 
dictates. When carrying on this kind of practice, the 
teacher dictates as rapidly as the pupils can write, or better, 
calculates the number of seconds required to write each sen¬ 
tence, or part of sentence, as was done for the timed-sen¬ 
tence spelling test. (See page 186.) This can easily be done 
by using the rates given on page 183. 

“ Developing a spelling consciousness.” The following 
device serves to direct the pupil to see his errors in a whole¬ 
some way. It has yielded very gratifying results in the 
Training School of the Kansas State Normal: * 

When the spelling sentences or lists have been written, 
each pupil is required (1) to mark each word, the spelling 
of which he doubts; (2) as far as possible he is encouraged 
to test the validity of his doubts by known means outside 
of the dictionary, finally checking up all doubted words by 
using the dictionary; and (3) he then writes all of the mis¬ 
spelled words, which he has thus detected, correctly spelled 
in separate lists; (4) at this point the pupils’ papers are ex¬ 
changed, the teacher spelling all words and the pupils 

' Lull, Herbert G., “A Plan for Developing a Spelling Consciousnesa”; 
in Elementary School Journal, vol. 17, p. 355, 
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marking those found to be misspelled on the papers; and 
finally (5), when the papers are returned to their owners 
the additional misspelled words discovered should be added 
to their individual lists. 

The pupil’s spelling is scored by the teacher on the basis 
of the correctness of his doubts as well as upon the number 
of words spelled correctly. In the absence of a scientific 
determination of the relative significance of spelling ofv^ords 
correctly and doubting correctly, the same value is assigned to 
each. The pupils are scored both for doubting words spelled 
correctly, and for not doubting words spelled incorrectly. 

QTJESTIONS AND TOPICS FOR STUDY 

1. Measure the spelllug ability of tie pupils of youi dass by means of a 
timed-sentence test and then dictate the test words as separate words. 
Compare the two sets of scores. 

5. Teachers frequently tell with pride that all but two or tliree of their 
pupils make a "grade of 100” on a certain test. Should the fact be a 
cause for a feeling of satisfaction? Were the pupils really tested? 

8, Dictate the words for the next spelling lesson before the pupils have 
studied them. Have each pupil make a list of the words which he 
misspells and also of the particular misspellings which he has used. 
Direct the pupils to base their study upon these lists. 

4. Construct a series of "timed-sentence spelling tests” for the elemen¬ 
tary school, using suitable words from the Ayres Scale. 

6. Why does a test of easy words fail to give a measure of spelling 
ability? 

6. Why must the relative difficulty of the words of a test be known if 
accurate measures are desired? 

7. Make a study of the ways in which your pupils misspell words. Also 
ascertain the causes for these misspellings. 

8. How can you use this information in making your teaching of spelling 
more effective? 



CHAPTER Vm 

THE MEASUREMENT OP ABILITY IN HANDWRITING 

The measurement of ability in handwriting involves 
(1) the measurement of the rate of writing and (2) the qual¬ 
ity. The rate is measured by having the pupil write under 
specified conditions for a convenient number of minutes and 
counting the number of letters written per minute. The 
measurement of quality is accomplished by securing a 
sample of the pupil’s handwriting and determining the speci¬ 
men on a handwriting scale which is equivalent to it in 
quality. The quality may also be measured by means of 
a score card. 

The measurement of the rate of handwriting. In measur¬ 
ing the rate of handwriting certam points must be kept in 
mind, 

(1) The teacher should see that all pupils are provided 
with good pen-points, ink, and paper unless they use pen¬ 
cils, in which case there should be a sufficient supply of well- 
sharpened pencils. All pupils should be supplied with two 
or three sheets of suitable writing-paper, 

(2) The pupils should be asked to write a sentence or a 
paragraph which they have memorized. To guard against 
lapses of memory, the pupils should be asked to repeat in 
concert the selection to be used. If convenient it is well to 
provide each pupil with a printed or typewritten copy of 
the selection. When this cannot be done, the selection may 
be written on the blackboard where all can see it. The 
selection should contain no words which the pupils cannot 
spell readily. It is well to have them practice writmg the 
more diflicult words before the test is begun. Do not use 
material which the pupils must compose as they write, for 
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this would be worthless in testing. The rate of writing un¬ 
familiar material from a printed copy will vary with the 
pupil’s rate of reading and so will not give a true measure 
of his rate. Dictated material should be used only when 
the teacher wishes to control the rate, not when the rate 
is to be measured. 

(3) The teacher must be provided with a watch which 
has a second-hand or with a stop-watch. A two- or three- 
minute period should be allowed and the teacher should 
exercise care to make this period exact. 

(4) Pupils probably have two or more rates of writing, 
one for the penmanship class when they are doing their best 
and another for writing exercises in history, language, or 
other school subjects. The way in which the teacher gives 
the directions to the class will influence their rate. If he 
tells the pupils or even suggests that they are expected to 
show how well they can write, the rate will probably be 
low. On the other hand, if the pupils are given the idea 
that the rate is most important, they will write more rapidly 
than they are accustomed to do. It is, therefore, important 
that a teacher follow directions which have been prepared 
for securing samples of pupils’ handwriting. We give below 
a set of directions which have been widely used. 

DmEcnoNS fob Obtaining Sampues 

When children have paper and pencil proceed thus: Bead aloud 
a stanza — four lines of the poem, “Mary had a little Iamb,” etc., 
which is printed below. If you are using these directions for the 
first time use the first stanza; if the second time, use the second 
stanza; it the third time, use the third stanza. Have the children 
recite this stanza aloud in unison until you are sure they all know 
it. Then ask them to write it once. Collect these copies and destroy 
them. Do not tell the children they are to be tested in any way. Next 
instruct the children as follows: 

“Write the stanza of the poem which you have learned. Write 
it just as you would in a composition or'in an ordinary school 
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exercise. If you finish the stanza, write it over again, and keep 
on writing until I tell you to stop. Write on only one side of the 
paper. When you fill one page use another. We niust start to¬ 
gether and stop togetlier. Lay your papers on your desk in posi¬ 
tion. Have pen and ink ready. When I say ‘Get ready,’ ink your 
pen and place your hand in position to write, but do not begin to 
write until I say ‘Start.’ Then all begin at once. When I say 
‘ Stop ’ I want you all to atop at once and raise your hands so that I 
can see that you have stopped.” 

Now take your watch in hand and when the second-hand reaches 
the SS second mark say, “Get ready.” Exactly at the 60 second 
mark say, “Start.” At the end of throe minutes call out, “Stop, 
hands up.” Be sure to allow exactly three minutes. Have each 
child write name and age on the back of the paper. Collect the sam¬ 
ples at once and put them together. 

I 

5 10 IB 

Mary had a little lamb, 

20 26 80 SB 40 

Its fleece was white as snow; 

45 60 BB eo 6B 

And everywhere that Mary went 

TO T5 BO B4 

The lamb was sure to go. 

n 

6 10 16 20 26 

He followed her to school one day; 

80 36 40 45 

That was against the rule; 

K) 65 60 © TO 75 

It made the children laugh and play 

60 36 90 95 or 

To see the Iamb in school, 

m 

5 10 15 20 26 

And so the teacher turned him out, 

30 35 40 45 

But still he lingered near, 

50 65 GO 66 TO 

And waited patiently about 

TB so 65 80 

Till Mary did appear. 
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Directions for securing samples for the “ Gettysburg 
Edition ” of the Ayres Scale. With the “Gettysburg Edi¬ 
tion” of his handwriting scale Ayres gives directions which 
should be followed when that scale is used. The directions 
are not entirely complete and should be supplemented by 
the last two paragraphs of the directions given above. 

To secure samples of handwriting the teacher should write on 
the board the first three sentences of Lincoln’s Gettysburg Address 
and have the pupils read and copy until familiar with it. They 
should then copy it, beginning at a given signal and writing for 
precisely two minutes. They should write in ink on ruled paper. 
The copy with the count of the letters is as follows: 

Four 4 score 9 and 12 seven 17 years 22 ago 25 our 28 fathers 
S5 brought 42 forth 47 upon 51 this 55 continent 64 a 65 new 68 
nation 74 conceived 83 in 85 liberty 92 and 95 dedicated 104 to 106 
the 109 proposition 120 that 124 all 127 men 130 are 133 created 
140 equal 145. Now 148 we 150 are 153 engaged 160 in 162 a 163 
great 168 civil 173 war 176 testing 183 whether 190 that 194 natipn 
200 or 202 any 205 nation 211 so 213 conceived 222 and 225 so 227 
dedicated 238 can 239 long 243 endure 249. We 251 are 254 met 
257 on 259 a 260 great 265 battlefield 276 of 278 that 282 war 285. 

Other selections which have been used. DiflPerent inves¬ 
tigators have required pupils to write different material. 
Several have used the first line or the first stanza of the poem 
“Mary had a little lamb,” which is reproduced above. “ Sing 
a song of sixpence” has been used. Other sentences which 
have furnished copy are: “Jolly kings bring gifts while 
happy maids dance.” “A quick brown fox jumps over the 
lazy dog.” ^ “Then the carelessly dressed gentleman stepped 
lightly into Warren’s carriage and held out a small card. 
John vanished behind the bushes and the carriage moved 
along down the driveway.” ® 

‘ This sentence was used in securing specimens for the Freeman Scale. 
It contains all of the letters of the alphabet. 

* These sentences were used in securing the specimens for the Thorndike 
Scale. 
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In the Cleveland Survey the first three sentences of Lin¬ 
coln’s Gettysburg Address were written, and Ayres has used 
this selection in the “Gettysburg Edition” of his scale. In 
several school surveys the pupils were allowed to write any 
familiar stanza of a poem. The chief principles to bear in 
mind in selecting materials are: (1) to use material in the 
lower grades which will not furnish difficulties in spelling 
and remembering; and (2) to use material which will be 
uniform in all classes which are to be compared. 

Marking the papers for rate of handwriting. Time can be 
saved by making use of tlie numbered selections given above. 
Divide the total number of letters written by the number 
of minutes allowed. The quotient is the number of letters 
per minute. This is the pupil’s rate score and should be 
written in the upper right-hand corner of his paper. 

Measuring the quality of handwriting by means of scales, 
The “quality” of a sample of handwi’iting may be measured 
by means of a “handwriting scale” which consists of a 
number of specimens of handwriting arranged in order of 
“quality.” The process of measurement simply consists of 
moving the sample which is being measured along the scale 
until a specimen of the scale is found which “matches” it in 
“quality.” The process is much like “matching” a sample of 
dress material or ribbon. Sldll in this “matching” or use of 
the scale comes with practice and it is recommended that a 
teacher prepare himself by at least a short period of training. 

Handwriting scales. The scales in most general use are 
the ones constructed by Thorndike^ and by Ayres.® 

* Thorndike, E. t,, “ Handwriting in Teachers College Record (March, 
1910), vol. 2, no. 6. The scale may be purchased from the Bureau of 
Publications, Teachers College, Columbia University, New York City. 

“ Ayres, L. P, A Scale for Measuring the Handwriting of School-Children. 
(Russell Sage Foundation, Bulletin 113.) Ayres has also constructed 
adult scale and the " Gettyabivg Edition." In this book the term " Ayre J 
Scale" refers to the “Gettysburg Edition" unless otherwi ^ %^^^»,.. | 
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Thorndike constructed his scale on the basis of three 
characteristics — beauty, legibility, and general merit. The 
degree of these characteristics represented in the specimens 
of the scale was determined by the consensus of opinion of 
competent judges. Ayres constructed his scale on the basis 
of legibility alone. He defined legibility in terms of ease of 
reading. That specimen was defined as most legible which 
was read most easily. The numerical values of the spech 
mens of the Thorndike Scale range from 4 to 18, one or more 
specimens being given for each degree of quality. 

Ayres’s Scale, “Three-Slant Edition,” consists of three 
types of specimens, vertical, semi-slant, and full slant. Each 
of these three types is represented by eight degrees of qual¬ 
ity to which are assigned the numerical values 20, 30, 40. 
up to 90. In using this scale it must be remembered that 
these values are not the same as the per cents used in 
reporting “grades.” 

Ayres^ later devised a scale from specimens of hand¬ 
writing written by adults. Trained judges used the “Three- 
Slant Edition” in selecting the specimens and in deter¬ 
mining their values. This “Adult Scale” is similar to the 
“Three-Slant Edition” in its general plan. Very recently 
(1917) Ayres devised a third scale, the “Gettysburg Edi¬ 
tion.” This scale differs from the others in the following 
particulars: It has one specimen for each step. The speci¬ 
mens are written on ruled paper. The copy is the same for 
all specimens. In addition to the specimens of the scale, 
this edition has directions for securing specimens from a 
class and for scoring these specimens. It also furnishes stand¬ 
ards for rate and quality of handwriting for the grades above 
the fourth. Ayres asserts that the purpose of these changes 
is “to increase the reliability of measurements of hand- 

^ Ayres, L. P., A Scale for Measuring the Handwriting of Adults, (Bassell 
Sage Foundation, Bulletin E 138.) 
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writing.” A recent investigation^ shows that measurements 
made by this scale are more reliable than when made by 
the “Three-Slant Edition.” 

Following discussion based on the “ Gettysburg Edition ” 
of Ayres’s Scale. Because more reliable measurements may 
be obtained by using the “Gettysburg Edition” of Ayres’s 
Scale, we shall base the following discussion upon it. It will, 
however, be an easy matter for any one to adapt it to any 
other scale. In order to understand the following pages the 
teacher should have a copy of this scale. See the Appendix 
for price list and directions for securing a sample package 
of tests. 

Training in the use of a handwriting scale. The accu¬ 
racy of a teacher’s measurements of quality handwriting 
depends upon the method he uses and upon his training in 
the use of that method. When a teacher is using a hand¬ 
writing scale for the first time the following preliminary 
exercise is recommended; 

Select ten samples at random. Number these samples and place 
their numbers on a blank sheet of paper. Now take the first sample 
and rate it thus: Place the Ayres Scale on a table in full view and 
in a good light. Place the sample directly under the scale division 
marked 30 and move it along toward 90, comparing it with each 
division. Decide which division of the scale it resembles most in 
quality. “Disregard differences in style, but try to find on the scale 
die quality corresponding with that of the sample being scored.” 
Then place it under the scale division marked 90 and work back 
toward 30 as before. Decide again which division it resembles 
most in quality. If your two judgments agree, mark the rating 
on the blank paper opposite the numeral 1. If the two judgments 
do not agree, compare the sample again with the two divisions 
of the scale and determine which it most nearly resembles. Proceed 
to rate the other samples in this manner, keeping the record for 

’ Breed, F. S., “The Comparative Accuracy of the Ayres Handwriting 
Scale, Gettysburg Edition”; in Sewentary SchoalJournal (February, 1918), 
vol. 18, p. 458. 
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each. When you have finished the ten samples, lay this record 
aside, out of sight. Rate the ten samples a second time, again 
keeping the records and again laying the records aside. Do this 
a third time, and when you have finished, compare your three rat¬ 
ings for each of the ten samples. If the three ratings for any one 
sample vary more than ten, satisfy yourself as to which rating is 
the correct one, by comparing it with the scale again. 

When convenient it is better to use samples whose correct 
rating is known. A set of fifty such samples may be obtained 
from the Bureau of Publications, Teachers College, Colum¬ 
bia University, New York City. They are rated in terms 
of Thorndike’s Scale, but these scores can be changed to 
Ayres’s Scale by multiplying by 6.7 and subtracting 20 from 
the product. The remainder is the true quality of the 
sample on the Ayres Scale. 

Method of using the scale. For using the “Gettysburg 
Edition*’ Ayres gives the following directions: 

To score samples slide each specimen along the scale until a 
writing of the same quality is found. The number at the top of the 
scale above this shows the value of the writing being measured. 
Disregard differences in style, but try to find on the scale the quality 
correspKjnding with that of the sample being scored. With practice 
the scorer will develop the ability to recognize qualities more rap¬ 
idly and with increasing accuracy. If the scormg is done twice, the 
results will be considerably more accurate than if done only once. 
The procedure may be as follows: Score samples and distribute 
them in piles with all the 20’s in one pUe, all the SO’s in another, 
and so on. Mark these values on the backs of the papers, then 
shuffle the samples and score them a second time. Finally make 
careful decisions to overcome any disagreements in the two scorings. 

Whenever three or more persons can work together in 
scoring specimens the results may be expected to be more 
satisfactory than those secured by independent work. All 
the members of the group should examine the specimen of 
writing and confer concerning the rating it should receive. 
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A majority of tlie group must agree before a score is assigned 
to tbe specimen. 

A method which will require more time, but one which 
will secure more accurate results than the methods de¬ 
scribed above, is one in which a group of three or more 
persons score the specimens independently, using the sorting 
method. Then the scores assigned by all of the judges to a 
specimen are averaged and the result taken as the true 
score for that specimen. The accuracy of the resulting scores 
will increase with the size of the group of judges. 

Recording scores. After the samples are rated the teacher 
must be careful that his papers are grouped correctly by 
classes. If he has but one grade of pupils, say fifth grade, 
or two divisions of the same grade, say fifth A and fifth B, 
then his papers may be all grouped together and but one 
distribution made. If, however, he has parts of two or more 
grades, say part fifth and part siirth, he must fill out a sepa¬ 
rate record sheet for each division. A convenient form of a 
class record sheet is shown in Fig. SO. 

Sort the papers from one class on the basis of quality. 
(For instance, put into one pile all those papers having a 
quality of 90, into another put all the 80’s, into another all 
the 70’s, and so on.) Then, one pile at a time, re-sort the 
papers in each of these piles on the basis of their score for 
rate, placing together those papers whose rates are 30 to 39, 
40 to 49, 50 to 59, etc. (For example, if there' were ten 
papers of quality 60, whose rates were 50, 53, 65, 62, 62, 64, 
69, 72, 77, 80, the first three would be piled together, the 
next four would form a second pile, the next two a third pile, 
and the last one would be placed by itself.) Next count the 
number of papers in each of these piles and record the num¬ 
bers in the proper vertical column of the table. (In om 
illustration this is the column under 60. There are three 
papers in the pile whose rates are between 50 and 59. Place 
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a figure 3 in the 60 column and directly opposite the numer¬ 
als 50 to 59. There are four papers in the pile whose rates 
are 60 to 69. Hence, a figure 4 is to be placed in the 60 col¬ 
umn and opposite the numerals 60 to 69.) Each of the 
other piles is to be treated in the same way. 

When all the scores have been entered, find the sum of 
the figures in each vertical column and in. each horizontal 
row. If your records have been accurately made, the sum 
of the horizontal totals will just equal the sum of the verti¬ 
cal totals. Save all specimens for future use. 

Computing class scores. The medians of the distributions 
(rate and quality) are used to designate the general standing 
of a class. The method of calculating the median, described 
on page 103, is used. It is necessary to remember that in 
the record sheet shown on page 213, the width of the inter¬ 
vals is 10, the same as in the accuracy distributions for arith¬ 
metic. When there are fewer than fifteen pupils in a class 
it is not wise to attach much importance to the medians. 
The distributions and individual scores are more significant. 

Measurement for diagnosis. The quality of a sample of 
handwriting is a complex product. It depends upon several 
characteristics of the handwriting, such as the uniformity 
of slant, uniformity of alignment, letter formation, and 
spacing. There are available two instruments for diagnostic 
measurement: 

1. Freeman’s^ Scale which differs from the other scales in 
an important respect. It is in reality five scales, one for each 
of the following characteristics of handwriting: uniformity 
of slant, uniformity of alignment, quality of line, letter 
formation, and spacing. These five scales are now printed 

1 Freeman, F. N., The Teaching of Eandwriiing. (Houghton Mifflin 
Company, 1915.) Also, “An Analytical Scale for the Judging of Hand¬ 
writing”; in ElemeniaTy School Journal (April, 1915), vol. 15, p. 432. A 
copy of the scale can be obtained from Houghton Mifflin Company, 
Boston. 
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on one sheet of paper or chart, and each scale is called a 
division. 

The first of the five divisions of the Freeman Scale repre¬ 
sents three degrees of uniformity of slant. In using this 
division, as in using the next division, judgments will be 
made more easily if a slant and alignment gauge is used.’’ 
The second division represents uniformity of alignment. 
The user must be careful to note that letters which are close 
together show deviations in alignment more prominently 
than letters written farther apart. 

The third division shows the quality of line or stroke. A 
reading-glass will aid in judging with this division. The 
fourth division is intended to measure letter formation. 
Freeman describes eight illegible forms of letters which 
should be counted as errors. Two principles should control 
here: (1) whatever slant or type of script the pupil may use, 
consistency to that choice should be maintained; and (2) no 
letter should vary from its recognized form so much as to 
be easily mistaken for another letter. The fifth division 
shows different kinds of spacing. Letters may be crowded 
or spread too far apart. The same applies to words. 

In each division the three degrees of excellence are given 
scores of 1, 3, and 5 respectively. The intermediate values 
of 3 and 4 may also be used. If the old edition of the scale 
is used, the scores assigned to the specimens of letter forma¬ 
tion are 2, 6, and 10. Freeman suggests that the specimens 
be scored by using the score for letter formation as placed 
on the new edition of the chart, and then doubling these 
scores in making up the total score. 

* Freeman, P. N., The Teaching of Handwriting, p. 151. The slant gauge 
consists of three rows of parallel lines. The lines in one row are vertical 
and in each of the other rows the lines are set at a uniform slant. The align¬ 
ment gauge consists of one straight line four or five inches long. These 
lines may be drawn on transparent paper and placed over a specimen of 
handwriting to assist in determining the deviations from uniformity in 
slant and alignment. 
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Using the Freeman Scale. This scale may he used for 
measuring specimens from all members of a class, but fre¬ 
quently it is used to measure specimens -written by those 
ranking conspicuously belo-w the average ability or below 
the standard ability for -the class. This needy group of 
pupils may be selected by the teacher’s unaided judgment, 
but preferably by the use of the Thorndike or Ayres Scale. 

Freeman ^ has recently issued the following suggestion for 
using his scale: 

The specimen to be judged is graded according to each category 
separately and given the rank of the specimen in the chart -with 
which it most nearly corresponds in each case. The total rank is 
calculated by summing up -the five individual ranks. Thus, if 
letter formation is given double value, the lowest possible rank is 
6 and the highest possible rank is 30 (5 +5 -j- 5 +10+5), and 
the range is 24. 

Several precautions are to be observed in making the judgments. 
The value of the metliod rests upon the fact that different features 
of the viriting are singled out, one at a time, and graded by being 
given a rank in one of only three steps. The difference between the 
steps are marked, and -the ease of placing a specimen should be 
correspondingly easy. 

This method implies, however, that 

(1) The attention is fixed on only one characteristic at a time. 

(2) The judgment on one point be not allowed to influence the 
judgment on the other point. 

(3) The same fault be counted only once. 

(4) General impressions be disregarded. 

The scores secured by means of the Freeman Scale should 
be saved to furnish a means of evaluating the results secured 
from instruction. The scores may be recorded on the speci¬ 
men, or, better, on an individual record cajd, such as shown 
in Fig. 31. The latter -will be more convenient when the 

^ Freeman, F. N., Experimevtci Education, p. 80. (Houghton Mifflin 
Company, 1916.) 
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Pupil’s Name . Ciiy . 



I>\Tsi trial 

Bale . 

Second trial 

J)nte. .. 

Third trial 
Bale . 

Fourth trial 
Bute. ,.. V, 

!? 

Oharb I 
(Hlant) 






1 

^ 1 

Clinrb II 
(Alignmeoti) 








Oharb III 
(■Quality of lino) 








Chart IV 

(Luttor formation) 






ii 

^ : 
s : 

Chart V 
(Bpaclng) 







Total (value on 
Freeman Scale) 








Quality (value on 
Ayres Scale) 








Speed 

(Lettcre per mlnubo) 









Fio. 31. Individual Record Card, Freeman Scale. 


teacher wishes to examine a series of scores recorded at 
intervals over a term of several months. 

2. Gray's Score Card for detailed analysis. The score card 
represents another attack upon the problem of measure¬ 
ment. It requires that the essential elements of handwrit¬ 
ing be selected and eacli assigned a value. The score 
card devised by Gray ^ weights the value of each of the 
essential elements of handwriting so that the highest value 
which can be assigned to slant is 6, while spacing of letters 
may receive 18, neatness, 13, etc. (See Pig. 32.) The use of 
this score card by teachers in their grading of handwriting 
would undoubtedly lend to direct their attention to the 
individual needs of the pupils. So far there is no evidence 
to show that its use will result in more accurate measures 
than the use of any one of the scales. Some claim that 

* Gray, C. TrumaD, A Score Card for the Measurement of Eandwriling, 
(Bulletin of the University of Texas, no. 87, July, 1015.) 
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Pt^ll . 


Date. 

Sample I^umber . 






Pig. 82. Standard Scokd Card for mbasdrinq Handwriting. {Devised 
by C. T. Gray.) 


the elements of handwriting have not been correctly evalu¬ 
ated. However, it has the advantage that its use trains 
the user in the analysis of handwriting. Gray well defends 
the device by saying that agriculturists have long used 
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such score cards to secure very satisfactory and accurate 
results in judging grain and live-stock. 

In using Gray’s Score Card and the Freeman Scale, 
measures of each of the several factors concerned in a 
pupil’s handwriting are secured. A record of successive 
measurements will show just what abilities have not been 
sufficiently improved. These abilities will then be the 
points of attack for the teacher and pupil in their subse¬ 
quent work. For example, a record as shown on the Gray 
Score Card might indicate that a impil’s handwriting was 
suffering chiefly because of poor letter formation. A closer 
inspection would show that letter formation was very 
often defective in two items, letters not closed and parts 
omitted. Such diagnosis reveals a definite problem for the 
teacher. 

Use of the score card. The score card (see page %V1) may 
be used for a pupil, or a class. If it is used for a pupil, the 
numerals along the top may be taken to indicate weeks, 
months, or other intervals. In the column under the 
numeral 1 the first scores of a pupil’s handwriting should 
be entered. A month later a second series of scores should 
be entered in the column headed by the numeral 2. The 
next month another scries of scores should be entered under 
numeral 3, and so on. At tlie close of a term there will 
appear a very useful record of the child’s experience in the 
learning of handwriting. This use of the score card Gray 
calls a clinical study. 

If the card Is used for a class, the numerals at the head of 
the columns stand for the specimens written by the several 
pupils of the class. The totals at the bottom will furnish 
an interesting comparison of the ability of the pupils. Each 
pupil knowing his number can tell how he stands in relation 
to the other members of the class. If a now score card is 
posted each month, a pupil may see whether he is gaining 
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or losing in his position in the class. If he is losing, he will 
be inclined to seek the reason. He may see that his neatness 
has a low score. This furnishes a strong incentive for work 
to improve in neatness. Teachers and supervisors might 
compare tlieir records. The use of the card may be varied 
by training pupils to score their own or others’ handwiiting, 
or by one teacher calling on another teacher to score the 
handwriting of his pupils. 

Standards. In Table XXII we give (1) standards pro¬ 
posed by Ayres for his “Gettysburg Edition”; (2) standards 
proposed by Freeman; and (S) “the Kansas Medians” 
which were obtained by using the directions given on page 
204. Table XXII is read thus: A second-grade class should 
have a median score for rate of 36 letters per minute, and 
a median score for quality of 44, when scored by the Ayres 
Scale. A third-grade class should have a median quality 
of 47 and a median rate of 48 letters per minute. The 
standards fox the other grades are read in the same 
manner- 

Taulb XXn. HANDwnmNG Staitoards — Ratb in letters 

PER MINUTE — QuALITT IN TERMS OP THE AyRES ScALB 


School grades 



11 

III 

IV 

V 

VI 

VII 

VUI 

Freeman standards — 

a 

47 


66 

60 


i 



48 



72 

luil 


Ayrei! ("Gettysburg Edition”) — 

38 

42 

mSm 


64 

i 68 



32 
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70 


80 
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Ayres’s standards represented graphically. Ayres has 
represented graphically his standards for the “Gettysburg 
Edition” as shown in Fig. 33. Quality is represented on the 

horizontal lines and 
rate on the vertieal. 
The positions of the 
small cireles indi¬ 
cate the standards 
for the roapective 
grofles. This plan of 
graphical represen¬ 
tation is frequently 
helpful in interpret¬ 
ing the scores of a 
cla-ss or of a school. 

The basis of sat- 
isfactoiy standards 
in handwriting. The 
standards of attain¬ 
ment are detemiued 
by two considerations: (1) tliey must l>e attainable by 
pupils under ordinary school conditions, and without tlie 
expenditure of an unreasonnldc amount of time and effort; 
(2) they should l)c high enough to assure that the pupil 
will have snfficicnt skill in writing to meet the demands 
which will be made upon him. These considerations ore 
emphasized by the facts tliat only a limited amount of 
time is available for the teaching of handwriting in tlie 
ordinary school, and that after practice has progressed 
for a time, it does not bring as large returns as it did in 
its initial period. 

The first of these considerations has Imen met by examin¬ 
ing the handwriting of tliousands of children, gathered from 
all parts of our country. Freeman used the results of the 
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scoring of about five thousand specimens from each of the 
seven grades. These specimens were selected from a large 
number of specimens which were collected in fifty-six large 
cities of the United States. He found that the average of 
the scores of the upper half of these specimens gave scores 
for rate and quality which are approximately the standards 
he proposes. In checking up the second considerationj Free¬ 
man investigated the demands which are made upon those 
who are employed in several large commercial houses. The 
returns from this investigation, together with the results of 
the other investigation, indicated that the standards as pro¬ 
posed are but little more than the minimum essentials. 
Moreover, Freeman estimates on good evidence that these 
standards can be attained with an expenditure of not over 
seventy-five minutes a week. 

Standards required for practical work. Pupils are taught 
to write for two reasons: (1) in order to be able to meet the 
practical demands for writing outside of school, and (2) in 
order to be able to do the writing that is required in school, 
particidarly in high school and college. Eventually these 
demands will determine the standards for both rate and 
quality. With reference to quality Ayres^ and Ashbaugh® 
have drawn certain conclusions from the requirements in 
handwriting which are set up by the examiners of the Muni¬ 
cipal Civil Service Commission of New York City. Ash- 
baugh quotes a letter from the Actmg Director of the com¬ 
mission as follows: 

I find that the Municipal Civil Service Commission of New York 
ordinarily uses the standard of 70 per cent as a passing grade in 
handwriting, but for positions where handwriting is a special 
requirement the standard is sometimes set at 75 per cent. 

‘ Ayres, L. P., A Scale for Measunng the Quality of Handwriting oj 
Adults. (RvLssell Sago Foundation, Bulletin E 138.) 

“ Ashbnugh, Ernest J., Handwriting of Iowa School Children. (Bulletin 
of the University of Iowa, March 1,1010.) 
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Ayres has shown that the ratings of 70 per cent and 75 per 
cent, as given by the commission, correspond respectively 
to scores of 40 and 50 on the Ayres Scale. Since this com¬ 
mission recommends many persons who cannot write better 
than the 40 specimen of the Ayres Scale, and recommends 
others who write only as well as the 50 specimen, for posi¬ 
tions where handwriting is a special requirement, it would 
follow that an ability to write as well as 50 on the Ayres 
Scale would be sufficient for all the demands which most 
pupils will meet. 

Koos^ has recently reported a study of the non-vocational 
handwriting of 1053 persons and also the handwriting of sev¬ 
eral vocational groups. He states his conclusions as follows: 

To write better thou 60 is to be in a small minority (18.5 per 
cent of 1053 cases) as concerns handwriting ability. Moreover, 
four-fifths of 826 judges consider the quality 00 adequate with a 
generous majority approving quality 50. In tlie liglit of these 
facts, it is difficult to sec why, for the we under consideration {non- 
vocational correspondence) a pupil should he required to spend time 
to learn to write better than quality GO. There is even considerable 
justification for setting the ultimate standard at 60. As this demand 
touches every member of society, all children in the schools should be 
required to attain the standard set. 

From the facta that have been presented touching the ability 
in handwriting of persons engaged in various occupations, it seems 
to tile writer that the quality 60 on the Ayres Measuring Scale for 
Adult Handwiting . , , is adequate for the needs of most vocations. 

. . . For that large group who vriU go into commercial work, for teleg¬ 
raphers, and for teachers in the elementary schools it will be necessary 
to insist upen, the attainment of a somewhat higher quality, but hardly 
in excess qf the quality 70. 

Standards required for school work. We have but little 
data on tlrls point, but many pupils come to high schools 

' Koos, L. V., “The Determination of Ultimate Standards of Quality 
in Handwriting for the Public Schools"; in Elementary School Journal 
(February, 1018), vol. 18, p. 422, 
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unable to write rapidly enough for the demands placed upon 
them. They then often sacrifice the quality of their hand¬ 
writing for the sake of greater rate. Lewis ^ examined the 
hand-writing of 17G0 third- and fourth-year students of 1G6 
Iowa Normal Training High Schools. He found their median 
score for quality to be 59.1 on tlie Ayres Scale, with a range 
from 34 to 89. Fifty per cent of the scores fell between 53.6 
and 64.3. The average rate of their handwriting was 90 
letters per minute. Thus, they rank with the seventh-gi’ade 
standard for quality, and the eightli-gradc standard for rate. 
Comparing their scores with those of eighth-grade cliildren 
(see Table XXII), these high-school pupils write from ten 
to fifteen letters per minute faster, but no better than the 
average eighth-grade pupil. These data bear out the state¬ 
ment that the higher schools require greater rate of hand¬ 
writing than the training of the elementary schools have 
furnished. Therefore, increased emphasis should be placed 
upon rate in teaching handwriting. 

Summary. This discussion of standard scores for hand¬ 
writing may be siumnarized by saying that tlrere is evidence 
til at the standards for quality given in Table XXII may 
be slightly higher than they should be, particularly those 
given by Freeman. The standards given by Ayres may be 
considered satisfactory. In the case of the rate of writing 
Freeman’s standards are probably the best. 

Types of situations revealed by the measurement of 
handwriting ability. Three types of situations which need 
corrective instruction may be recognized: (1) the median 
rate of writing is below standard; (2) the median quality is 
below standard; (3) the scores are too widely scattered. 

Type L Below standard in rate of writing: The Cause. 

1 Lewis, E. E., "The Present Standard of Handwriting in Iowa Normal 
Training High Schools”; in Educaiiontd Administration and Supervision 
(December, 1915), vol. 1, pp. 003-71. 
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Fig. 34 represents the distribution of scores for a third- 
grade class. The numerals along the bottom of the figure 
denote quality on the Ayres Scale, and the rate in terms of 
letters written in one minute. The numerals along the side 
indicate tlie number of pupils. A perpendicular solid line 
shows the location of the median for the class, and a por- 
irendicular broken line shows the location of the standard 
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for that grade. This class is below standard in both rate 
and quality. The quality will be considered under Type II. 
When tlie median rate of writing of a cla.s3 is conspicuously 
below standard, os is the cose of the third-grade cln.ss shown 
in Fig. 34, it is almost certain Lliat the teacher is failing to 
place sufficient emphasis upon rale in his instruction. The 
author has found teachers and even supervisors of hand¬ 
writing who admitted that they had given no attention to 
the rate of writing, but it was obvious tliat rate was impor¬ 
tant as well as quality, A few pupils are very slow in their 
movements, and this may account for the low rate of indi¬ 
vidual pupils, but not for a low median score except in very 
unusual cases. 

The corrective. In considering corrective instruction for a 
class whose median rate score is below standard, it is ncces' 
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sary to bear in mind the relations which exist between rate, 
movement, rhythm, and quality. Investigation^ has shown 
that the kind of movement, finger, arm and finger move¬ 
ment combined, or arm movement, does not affect the rate 
of writing when it is carried on for only a short time as is the 
case in the measurement of ability in handwriting. The 
apparent greater ease of production of arm or muscular 
movement may result in greater rate if rate is measured 
during a long period of wi’iting. 

Nutt has recognized what he calls “rhythm.” This is a 
quality or characteristic of the movement. It increases with 
age, but has no relation to amount of arm movement or to 
the quality of the writing. Nutt found that rate of writing 
and rhythm increase together; that is, ehildren who score 
high in rhythm also score high in rate, but may not use arm 
movement or produce a better quality of handwriting than 
other children. 

Relation between rate and quality. Several studies have 
sought for a relation between rate and quality of hand¬ 
writing. In the Cleveland Survey “ it was found that “in 
general speed and quality vary inversely. But there is a 
middle scries of speeds and qualities where improvement 
in one does not seem to interfere with the other”; that is, 
outside of the limits which ore approximately those of the 
proposed standards, efforts to secure an unusual degree of 
quality will reduce the rate, and vic& versa. Several inves¬ 
tigations of adults’ handwriting show that they tend to 
increase the rate and reduce the quality. A general view 
of the results bearing on this point shows that the children 
who write a good quality on the average write as rapidly 
as those who write a poorer quality. This seems to be due 

Nutt, H. W., "Rhythm in Handwriting”; in Elementary School Jour¬ 
nal, vol. 17, pp. 432-4'5. 

’ Judd, C. IL, Measuring the Work of the Public Schools, pp. SO-Sl- 
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to the natural rhythm of the children. If this rhythm is 
forced or disturhed unduly the quality sufler.s. Thorndike’s 
results indicate that causing a pupil to write more slowly 
than his normal rate did not improve the quality of the 
handwriting. 

Drills for increasing the rate of writing. Since within 
limits the rate of writing may Im increased without seriously 
disturbing the quality, it will be possible in some cases to 
bring the median rate up to standard by rate drills in which 
the pupils are caused to write at standard rates. A con¬ 
venient device for doing this is represented by the following 
example. This is a dictation exercise arranged for the sixth 
grade. The rate of dictation which is indicated by the num¬ 
bers printed above the words is based upon Freeman's 
standards. (See page 819.) The teacher should direct the 
class to be ready to write, tlien, walcliing the second-hand 
of his watch, until it is at 00, start to dictate. A little pre¬ 
liminary practice will make it cosy to dictate the words so 
tliat they will be pronounced as indicated, For example, the 
teacher should be pronouncing the word “care” just before 
tire second-hand reaches the tcn-second mark, etc, 

B 10 20 80 

Do you take care to keep your teeth very clean, hy washing 

40 00 (X) ID 

them without failing every morning and after every meal? This 
_ 20 30 40 DO 00 

is very necessary both to preserve your teeth a great while, and 
10 20 
to save you a great deal of pain. (Stop.) 

At first a class will not be accu.stomed to this form of 
exercise and may not respond in a satisfactory manner, but 
a little patience on the part of the teacher will soon elimi¬ 
nate such temporary confusion. The rate of a class which 
is far below standard should be gradually increased. For 
example, if the sixth-grade class is below the fourth-grade 
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standard, a dictation exercise arranged for the fourth 
grade should be used. When the class is able to respond to 
this satisfactorily, the dictation exercise for the fifth grade 
should be used and later the one for the sixth grade. 

If the quality of tlie handwriting of certain pupils de¬ 
creases because of such drills, these pupils should be excused 
from them or a different type of drill used. The following is 
a modification which will be helpful in such cases; the sen¬ 
tence, “The quick brown fox jumps over the lazy dog” 
contains tliirty-five letters. 

8tli-gTnde pupils should write llns 11 times in 4 min. 


7th 

(1 

H 

« 

4< 

14 

B " 

" 3 

“ SObcc. 

0th 


n 

<( 

•1 

41 

0 ” 

“ 3 


fith 


a 

i4 

« 

4C 

5 " 

■■ 2 

“ 46 •' 

4th 


(i 

<t 

4i 

44 

4 " 

" 2 

" 30 " 

3d 

t< 

<( 


44 

41 

3 " 

“ 2 

“ 10 " 

2d 

it 



44 

44 

2 " 

" 2 

41 


The pupils should memorize the sentence and write it 
several times for practice and for spelling. The teacher 
should then lime tlieir writing. Those who do not write the 
required number of letters in the allotted time, as given in 
the table above, should be told to write foster, until they 
have done the test successfully. 

Developing rhythm. If such exercises as described above 
reveal a serious sacrifice in the quality when the rate is in¬ 
creased, or if the pupil’s handwriting cannot be brought up 
to standard rate, we may consider that the pupil’s rhythm 
has not developed to the place where it will sustain this 
rate. Since we do not know which is the primary factor, 
rhythm or rate, the best procedure would be to seek to 
develop both. Ilhytlim may be increased by tire use of 
music. If the school owns a phonograph, records suitable 
for use in penmanship classes may easily be secured. The 
time of the music may be adjusted to the grade. Careful 
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attention to the securing of a free, well-relaxed hand posi¬ 
tion will aid in securing rate. Sometimes a careful analysis 
of letter forms will reveal that the pupil is forming some 
letters in a way that makes a satisfactory rate impossible. 
In such cases new forms of those letters should he taught. 

Type 11. Below standard in quality of writing. This con¬ 
dition may occur along with an unsatisfactory rate, as in 
Fig. S-i, or when the rate is up to or above standard. In 
attempting to increase the median quality of the handwrit¬ 
ing of a class, methods and devices used should be selected 
in the light of facts which have been established by investi¬ 
gations of the learning process,^ as it occurs in learning to 
write. There are not sufficient data from comparative studies 
of different penmanship systems to establish any single sys¬ 
tem as superior to others in its effectiveness to secure results 
in terms of rate and quality of handwriting. Hence, the cor¬ 
rective to be sought is not some system of writing which is 
a panacea for all handwriting troubles. 

General laws of learning appHed. The ability to write 
well is a habit; hence, the laws of habit formation apply to 
the acquisition of this ability. 

Tha first essential factor is a right start. The pupil must 
have a clear view of the habit to be acquired. This may 
mean a definite idea of tlie movement to be executed, or a 
picture of the letters or series of letters which are to be made. 
The start must be made with a strong initiative. Sometimes 
the pupil must be shocked into a desire to correct a fault of 
his handwriting. 

The second essential is that of attentive repetitions. The 

1 No attempt ia made to review or to criticize tlie material which ap¬ 
pears in numerous manuals of handwriting. Much excellent material which 
appears in The Teaching of UandwrUing, by liVeeman, is not even men¬ 
tioned, because of lack of space. The difficulty of conlining this discussion 
to the actual facta discovered through measurement of handwriting will 
be apparent. 
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repetitions or'drills should be strongly motivated. All inves¬ 
tigations of habit formation agree upon this point. The 
periods of practice are most efficient if not carried to tlie 
point of fatigue; hence, for the lower grades Freeman sug¬ 
gests frequent ten-minute periods of practice. In no grades 
should the periods be longer than twenty minutes. 

The third step, as often stated, is, “Allow no exceptions to 
occur.” If a pupil practices correct form in the penmanship 
class for ten minutes, and then uses poor form in a spelling 
class for the same length of time, tlie latter exercise will 
tend to cancel the elfects of his practice in the penmanship 
class. 

A. fourth step is the repetition of the habit until it is well 
fixed. This means that the repetitions must extend beyond 
the point of apparent completion to permanent automatism. 
After this stage is reached, incentives should be found 
which will raise the habit from the level of mere automatism 
to higher levels of skill. 

Motivating practice. A number of devices and jdans have 
been proposed for the motivation of practice in correcting 
faults in quality of liandrvriling. Wilson ‘ gives the result 
of an interesting experiment in which the Thorndike Scale 
was used in such a way that the students could follow their 
awn progress in handwriting. In this case each student was 
competing with his own record. Several teachers have 
constructed scales from the specimens collected in a school 
or class. These scales may be constructed by rating the 
specimens with any one or more of the scales described. 
Superintendent Bli.s3 of the Montclair, New Jersey, schools 
is quoted by Wilson os follows; “A scale made from the 
writing of pupils makes a stronger appeal than either the 
Ayres or Thorndike Scales.” A scale, either one made from 

^ Wilson and Wilson, The Motivaiion of School Work (Houghton MifiSin 
Company, 1910), p. 187. 
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specimens collected in the school or one of those described 
on page 308, should be posted in the schoolroom and pupils 
encouraged to compare their handwriting with it frerpiently. 
For this purpose the Ayres Scale is most convenient. 

Charters ^ recommends a “writing hospital” to which the 
poor writers are sent until they are properly convalescent. 
This hospital is a special penmanship class. Stonehas a 
plan which puts all the pupils of a school in four groups for 
their writing lessons. These arc groups 1, 2, 3, and the 
excused group. The special feature of this i)lan is that at 
stated intervals members of a lower group are allowed to 
challenge members of a higher group, and a contest for the 
coveted place ensues. 

Many special devices for motivation are in use. Pupils 
write letters ordering supplies for the school, or they write 
invitations to school parties, pageants, etc. Some pupils 
write letters for the teacher or principal. 
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Type HI. Scores too widely scattered. The scores of a 
fourth-grade class of this type are shown in Fig. 85. As in 
the case of other school subjects, the pupils who are grouped 
together in any scliool grade will be found to differ widely 

' Charters, W. W„ TeacMnff llte Common Branchea. (Houghton Mifflin 
Company, 1910.) 

• Stone, C. R., "Motivation of the Formal Writing Le-sson Through a 
Special Classification of Fupila for Writing”; in School and Uomo Hdncalion, 
June, lOlS. 
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in boLli rate and quality. However, these differences should 
be reduced to a minimum. Mg. 36 represents the scores of 
a fifth-gi’ade class which exhibits what probably should be 
regarded as a satisfactory condition. The differences be¬ 
tween the members of tliis class are much less than those of 
the class shown in Fig. 35. 
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In connection with his “Gettysburg Edition,” Ayres has 
given standard disti'ibutions for tlie four upper grades. 
These are reproduced in Pig. 37. The teacher may use tliem 
to ascertain whether or not the scores of his class are too 
widely scattered. 

Correctives. The reduction of a high degree of individual 
differences is largely a matter of dealing with individual 
pupils. A reclassification may be wise where it is possible, 
but for the most part the classification of pupils is deter¬ 
mined by their standing in other subjects. Those pupils 
who are distinctly above tlie eighth-grade standard should 
be excused from the penmanship class. They may spend 
the time thus saved upon other subjects. Dictation exer¬ 
cises, such as described on page 226, will tend to reduce the 
degree of individual differences in rate of writing. 

Diagnostic measurements. In the case of pupils who ore 
below standard in quality, it is helpful to diagnose their 
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handwriting using either Freeman’s Scale or Gray’s Score 
Card. This will give the teacher a statement of the particu¬ 
lar defects which exist and this information will provide a 
basis for prescribing corrective instruction. As typical of 
this procedure we quote the following 

A detailed analysis of the faidts which appear in thediild’s 
writing and of the adjustments wliioh arc necessary to correct them 
has been worked out by Mr. C. W, Reavts, I’rincipal of the Laclede 
School, St. Louis, Missouri, on tlic basis of his experience in suiKjr- 
vision, and is hero presented with his permission. 


Analysis of Defects m Writinq and their Causes, in use bt 
Principal Reavis 


Dcjccl 


Too much slant 


Writing too straight 


Writing too heavy 


Writing too light 


Writing too angular 


Cause 

1. Writing arm too near body. 

4. Thumb loo stiff. 

3. Point of nib too far from fingers. 

4. Paper in wrong position. 

6, Stroke in wrong direction. 

1. Arm too far from body. 

2. Pingprs too near nib. 

3. Index finger alone guiding pen. 

4. Incorrect position of paper. 

1. Index finger pressing too heavily. 

2. Using wrong pen. 

8. Penholder of too small diameter. 

1. Pen held too obliquely or too straight. 

2. Eyelet of pen turned to side. 

3. Penholder of too large diameter. 

1. Thumb too stiff. 

2. Penholder too lightly held. 

3. Movement too slow. 


' Freeman, P. N., The Teaching qf Handwriting (Hopghton Mifiilm Com¬ 
pany), pp. 7X-J3'2. 
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1. Lack of freedom of movement. 
Writing too irregular 2. Movements of hand too alow. 

3. Pen gripping. 

4. Incorrect or uncomfortable position. 

1. Pen progresses too fast to right. 
Spacing too wide 2. Too much lateral movement. 


QUESTIONS AND TOPICS FOR STUDY 

1. A teacher may judge the handwriting of his class by watching the 
pupils while they write or by examining the apeeimens which they 
have written. Which is the better method if the purpose is to make 
comparisons of classes? Which is belter for discovering the hand¬ 
writing defects of individual pupils? Wliat factors would you keep in 
mind in wntcliing children while they write? What factors in the 
oilier metliod? 

2. Ask a class to write the lliree sentences from Lincoln’s Octtyshurg 
Address. Direct them to start together and write ns rapidly ns they 
can for one minute. At the end of one minute stop them and direct 
them to record the number of IcUcrs they bnvo written. I'hen ask 
tliem to begin again and wite for one minute ivriting as trcll as they 
can. If you wish to eliminate practice effects, repeat tlie experiment, 
again reversing the order of the directions. Note the difference in 
the rates due to the nature of the directions. 

8, Select ten or preferalily one hundred .specimens of handwriting and 
rate them every day for several days liy means of the scale you have. 
Keep the record of yoiu- ilay's raliiig, hut do not use them to help you 
in making future ratings. After several ratings note the consistency 
of your nitlngs. 

4. Use tlie Gray Score Card (or IVeemnn Scale) in scoring the poorer 
specimens of handwriting. Prescribe the drills you would use in cor¬ 
recting those defeeta. Compare this with tlic recommendations of 
other teachers or students. Try your prescription on the pupils con¬ 
cerned if possible. 

6. For what purpose would you use the dictation exercises? 

6. Select a detect of letter fnrmotion frequently found in a pupil's hand¬ 
writing. Direct the pupil's attention to this defect and clinllenge him 
to correct it. Direct that a record be taken ns follows: It the defect 
were found in letter "a" instruct the pupil to count the number of 
such errors to be found in fifty consecutive “n’s" ns tliey occirr in bis 
handwriting written prior to the time you pointed out tlie defect. 
After a period of practice, direct the pupil to make another counting 
from his handwriting written at some period other than the writing 
period. 



CIIAPTER IX 

THE MEAST3EEMENT OF ABILITY IN LANGUAGE AND 
GMMMAB 

The measurement of ability to write compositions. The 
plan for measurinR the ability of pupils to write composi¬ 
tions is very similar to that used for handwriting. Compo¬ 
sition scales have been devised which consist of a number 
of compositions arranged in order of merit, and a pupD’s 
composition is measured by “matching’* it with the com¬ 
position of the scale which most nearly equals it in merit. 
As in the case of handwriting, care must be exercised in 
securing compositions from pupils. The first draft of a 
composition is frequently inferior to die form obtained 
when it has been rewritten. Also there will probably be a 
difference between compositions written as a class exercise 
and compositions prepared an home work. 

The Willing Composition Scale for measuring composi¬ 
tions wrritten as a class exercise. Willing* has devised a 
scale which consists of compositions written as a class exer¬ 
cise. The topic was “An Exciting Experience.” Several 
particularly exciting experiences were suggested by the 
teacher and the pupils were allowed twenty minutes for 
writing. The compositions were rated both for form (errors 
in spelling, punctuation, capitalization, and grammar) and 
for “story value.” Those chosen for the scale increase grad¬ 
ually in both form and “story value.” The scale is repro¬ 
duced here so that teachers may understand better this 
type of measuring instrument in the field of composition. 

* Willing, M. H., '"The Measurement of Written Composition in Grades 
IV to VIII”; English Journal (March, 1018), vol. 7, p. 193. 
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WitLiNQ Scale eoh Measuring Written Composition 

(The values: 90,80, 70, 60, 50, 40, 30, and @0 given the respec¬ 
tive samples are arbitrary and merely for practical convenience. 
20 means 15 to 24.9, 30 means 25 to S4.0, etc.) 

20 

Deron the summer I got kickctl and sprain my arm. And I was 
in bed of whecks And it happing up to Wa.shtion Park I was go¬ 
ing to catch some fish, And I was so happy wlicn I got the bangcTl 
of I will nevery try that stunt againg 


Number of mistakes in spelling, punctuation, and syntax per 
hundred words, 30, 

30 

The other day when I was rideing on our horse the englon was 
comcing and he got frightened so he through me down and I broke 
my hand. 

And the next thing I done was I went to the doctor and he put 
some bandage on it and told me to come the next day .so I came 
the next day and he toke the bandage olf and he look at it and then 
it was better. 


Number of mistakes in spelling, punctuation, and syntax per 
hundred words, 23. 

40 

My antie had her bam trown down lost week and had all her 
chickens killed from the storm. Whitch happened at twelve oclock 
at night. She had 80 chickens and one horse the house was saved 
he ran over to our house and claped on tlic dor whit his feet. Wlien 
We saw him my father took him in the bam where he slepi>ed the 
night witli our horse. Wlien our antic told us about the accident 
we were very sorry the next night all my antics things wore frozen. 
The storm blew terrible the next morning and I could not go to 
school so I had to stay home the whole week. 


Number of mistakes in spelling, punctuation, and syntax per 
hundred words, 17. 
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50 

One time mother and father were going to take sister and I for 
a long ride thanksgiving, We had to go 00 miles to get there. When 
sister and I herd about it we were very glad. It was a very cold 
trip. We four all went in a one seated automobile. Dady drove 
and mother held me and sister sat on tlic top the top was down. 
Mother could not hold sister for she was two heavy. When we 
got there they had a hot fire ready for n.s and a goo.se dinner. We 
were there over night. In the morning it was hot out. This was 
on a farm. Sister and I got to go hor.se-baek riding. It was lots of 
funs. They had children. The children were very nice. Our trip 
home was very cold. When we got home it had snod. 


Number of mistakes in spelling, punctuation, and syntax per 
hundred words, 14. 

60 

One time when mother, some girl friends and myself were 
staying up in the mountains. An awful storm came up. At the 
we were way up the mountain. The lightning flashed and the 
thunder roared. We were very frightened for the cabin we were 
staying at was at the foot of the mountain. We did n’t have our 
coats with us for it was very warm when wc started. There were 
a few pine trees near us so we ran under them. They did n’t do 
much good for tlic rain came down in torrents. The rain came 
down so hard that it ujjrofjled one of the ti'ees. Finely it began to 
slack a little, So we tJiought wc would try and go back. About 
half way down the mountain was a little hut. We started and when 
got about half way down it began to rain all the harder. We did n’t 
know what to do for this time there was n’t any trees to get under. 
We decided to go on for the nearest shelter was the hut, Finely we 
got there cold and wet to the skin. 

Number of mistakes in spelling, punctuation, and syntax per 
hundred words, 11. 


70 


When I was in Michegan I liad an exciting tiling happen or 
rather saw it, it was when the big steamship plying between Chi- 
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cago and Muskegon was sunk about 7 o’clock in tlic evening. It 
cauglit on fire with a load of cattle and products from the market 
on board, one of the lifeboats carrying some of the peoi)le who were 
on board landed at our pier. Tiie “Whnlcback” steamer which 
goes between Chicago and Muskegon was two hours later in coming 
than the freighter and was stopped to clear up the wreckage, all 
of the cattle and products and an immense cargo of coal were lost, 
but there were only two people lost, the ship tried hard to get to 
port witli her cargoc but, could not reach it. The next morning 
we found planks, and parts of the wreck on the bench. Our cottage 
was at the top of n cliff and it was ju.st one hundred feet to the lake 
from our cottage, we had a beautiful view, and the sight of the fire 
on the horizon was a beautiful sight (though it was pitiful). 


Number of mistakes in spelling, punctuation, and syntax per 
hundred words, 8. 

80 

Near our ranch in Fort Logan there was a chicken ranch. One 
day my sister and I went up to tlie chicken ranch on our horses. 
Coming back there was a road leading from our house to the main 
road and along this road were half rotted stumps. On every one 
of these stumps what do you think we saw, 'VVe saw snakes! simkcsl 
snakes! I suppose these snakes were shedding their skhis, they 
were of every color, shape, and size. Rut when sister and I saw 
tliese snakes we whipi>cd our horses into a gallop and away wo 
went just a.s hard as we could go. When we got to the house we 
went in and mamma could n’t get us out of the house that day. I 
was so scared that I believe I dreamed about snakes for a month, 


Number of mistakes in spelling, punctuation, and syntax per 
hundred words, B, 

90 

The most exciting experience of my life happened when I was 
but five years of age. I was riding my tricycle on the top of our 
high terrace. Beside the curbing below, stood a vegetable wagon 
and a horse. Suddenly I got too near the top of the terrace. The 
front wheel of my tricycle slipped over and down I went, licety- 
split, under the horse standing by the curbing. I had quite a high 
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tricycle and the handlebars scraped the horse’s stomach, making 
him kick and plung in a very alarming manner. I was directly 
under him during this, but finally rolled over out of his way and 
scrambled up. I looked at my hands I Most of the first finger and 
part of the thumb of my left hand were missing. The horse had 
stepped on tlicm. I had endured no sensation of pain before this, 
but now my manglerl hand began to hurt terribly. I was hprried 
to the hospital and operated on, and now you would hardly notice 
one of my fingers is missing. I certainly have good cause to con¬ 
gratulate my.self on my good fortune in escaping with as little in¬ 
jury to myself os I did, for 1 might have been terribly mangled in 
my head or body. 


Number of mistakes in spelling, punctuation, and syntax per 
hundred words, 0. 

Directions txm ubinq Wilmng’b Scaub for Written 
Composition 

In using the Composition Scale, these directions should be fol¬ 
lowed carefully because the compositions were written by school 
children who followed these same directions. 

1. The teacher should make certain that all pupils are provided 
with good pen points and ink, or well-slmrpened pencils if pencils 
are to be used. Have distributed to each pupil two sheets of 
tlieme paper (approximately 8^ by 11). It is best to use theme 
paper which has printed at the lop the suggested list of topics. 
If tills kind of paper is not used, the teacher must write the fol- 
lowmg list of topics on the blackboard: 

An exciting experience. 

A storm. 

An accident. 

An errand at night. 

A wonderful story. 

An unexpected meetmg. 

In the woods. 

In the mountains. 

On the ice. 

On the water. 

A runaway. 
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2. The teacher should then say to the pupils: “I want you to 
write me a story. It is to be a story about some exciting experience 
that you have had, about something or other very interesting that 
has happened to you. If nothing of the sort has ever happened 
to you, tlvcn tell me of an exciting experience some one you know 
has had. You may even make up a story of this kind, if you have 
to, though I believe you will do better, on the whole, with a real 
one. I am going to give you about twenty ininute.s in which to 
write. You are to Write on both sides of the paper, to do all the 
work yourselves, and to ask no que.stions at all after you begin. 
You may make whatever corrections you wish between the lines. 
There will be no time to rewrite your story. 

“The general subject together with sonic suggestions is printed 
at the lop of the paper on which you are to write. (I have written 
the general subject ou the hlackhoanl, together with some sug¬ 
gestions.) You do not have to write on any of these topics unless 
you want to; tliey arc merely to help out in case you cannot think 
of an exciting experience your.sclf. You may begin now as soon 
as you wish.” 

3. Allow opportunity for asking questions and make an effort 
to put tlie children at case. Allow full twcnity minulc.s for the 
actual writing. At the cud of this Lime say to the pupils: 

“You are to have four or fi\-e minutes in which to finish your 
stories; make corrections and count the number of words written. 
Write this number at the end of your story, write also your name, 
age, and grade.” 

At the end of five minutc-s collect Uic papers. 

It is important that the pupils be not allowed to correct their 
compositions, except such corrections ns they may moke during 
tliis period of four or five minutes. The teacher must remember 
that it is this type of composition which was used in making tlie 
scale and establishing the .standards. 

4. In rating the compositions by means of the scale, two quali¬ 
ties are recognized: (1) “story value” and (2) “form value.” The 
comiKisition should he rated for “story value” first. 

Rating for “Story Value.” Read tlie compositions, neglecting 
all errors of grammar, punctuation, capitalization, and spelling, 
and keeping in mind only the value of the story which the pupil 
is telling. As the compositions are read, sort them into piles, 
placing in one pile those which most nearly resemble in “story 
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value” composition 20 of the scale; in anotlier pile those which 
most nearly resemble composition 30; in another pile those which 
most nearly resemble composition 40; and so on for the other 
compositions of the scale. 

After this is done, compare the compositions in each pile with 
each other, in order to make sure that the rating has been done 
correctly. Make any adjustments whieh you think should be 
made. Mark each comiHJsition with the value of the scale com¬ 
position which it most nearly resembles. In case you believe that 
tlie true “story value” of the pupil’s composition lies between 
that of two of the scale comiiositions, the interpolated marks 25, 
36, ete., may be used. 

Rating for “Form Value.” After the compositions have been 
rated for "story value,” carefully mark all errors in grammar, 
punctuation, capitalization, and spelling. Count these errors and 
multiply the total by 100. Divide this number by the number of 
words ill the composition. This quotient is the number of errors 
per hundred words. 

The quotient found, as directed above, and the “story value” 
of the composition constitute the pupil’s score. These scores are 
valuable to the teacher. They show the standing of each pupil 
in two respects. They tell the teacher whether the pupil needs to 
give attention to the “form” of his writing (grammar, punctuation, 
capitalization, and spelling) or to the “story value,” or to both. 

Recording the scores. For recording the scores the record sheet 
shown in Fig. 38 is used. Sort tlie compositions for a class into piles 
according to their “story value.” (By a class we mean the pupils 
who belong to the same grade and who recite together. If a teacher 
has a class composed of pupils belonging to two grades — say some 
belonging to 5 A and some belonging to 0 B — it will be neces¬ 
sary to make two tabulations.) 

If interiiolated values have been used, they should be grouped 
according to the explanation of the scale value which is given 
at tlie top of the scale. 

Take tlie compositions whose "story value” is 20. These are 
to be listed in tlie first column of the table in the .space which cor¬ 
responds to their “form value.” For example, m the first space 
of tills column record the number of these compositions whose 
“form value” is between 0 and 2.9; in the second space record 
the number of compositions whose form value is between 3 and 
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5.9; in the third space record the number of comjmsitions whose 
“ form value ” is between 6 and 8.9, etc. After the compositions 
in each pile have been recorded in this way, the number of com¬ 
positions recorded on each line should be counted and the total 
entered in tlie total column. The some should be done for the 
compositions entered in each column. 

Finding the class scores. The median score for form value 
may be found by arranging the compositions in order of the 
form scores and taking the score of the middle composition. 
In case there is an even number of papers, the average of 
the scores on the two middle ones should be taken. The 
median score for “story value” may be found in the same 
way. The median scores may also be calculated from the 
distributions by following the directions given on page 103. 

Tentative standards. Tentative standards for Willing’s 
Composition Scale are given in Table XXIII. It will be 
noticed that the median scores for Denver are conspicuously 
below those for five Kansas cities. This may be due to the 
fact that reports have been received from only a few cities. 


Table XXIII. Median Scobes fob Willtno’s CoMrosmoN 

Scale 


OraSe 

Denver 

1 

1 Jfive ICaniOM cities 





IV. 

82 

! 

22 

44 

12 

V. 

48 

is 

68 

10 

vi; . 

flO 

14 

76 

5 

VII. 

60 

11 

77 

6 

VIII. 

63 

10 

82 

0 


Other scales for measuring written composition. A scale 
called the Nassau County Supplement has been devised by 
Trabue. It consists of nine compositions, seven of which 
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were written by elementary-school pupils on the topic, 
“What I should like to do next Saturday.” It is designed to 
measure only “story value” of compositions. Coi)ies of 
this scale may be obtained from the Bureau of Publications, 
Teachers College, Columbia University, New York City. 

The IliUcgas Scale consi.sts of ten compositions ranging 
from an artificial production whose scale value is zero to the 
tenth composition whose scale value is 9.3. Three of the 
ten compositions are artificial productions, five were written 
by high-school pupils, and the remaining two by college 
freshmen. No two were written on the same topic and they 
vary greatly in length and type. In the Thorndike Extension 
of the Hillegas Scale, only a few of the compositions of the 
original scale have been used and several compositions are 
given for each degree of merit in the middle of the scale. 
Twenty-nine compositions represent fifteen degrees of merit 
within approximately the same range as the original scale. 
This makes a more finely divided scale than the original one. 
Copies may be obtained from the Bureau of Publications, 
Teachers College, Columbia University, New Yorlc City. 

The Harvard-Newion Composition Scale consists of four 
separate scales, one for each form of discourse; argumenta¬ 
tion, description, exposition, and narration. Each of the 
scales consists of six compositions written by eighth-grade 
pupils and arranged in order of merit as determined by the 
marks assigned by teachers rating them as eighth-grade 
compositions. For each composition there is given a state¬ 
ment of the most significant merits and defects. Copies of 
the scale may be secured from the Harvard Univer.sity Press, 
Cambridge, Massachusetts. 

The compositions used by Breed and Frostic^ in deriving 

* Breed, F. S., and Frostic, F. W., "A Scale for Meagiiring the General 
Merit of English Composition”; in ElemeniaTy School Journal, vol. 17, 
9P. 807-25. 
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their scale were written by sixth-grade pupils under uniform 
conditions. A part of the story called “The Picnic” was 
read to the class and they were given twenty minutes to 
complete it. The method of selecting compositions for the 
scale and determining scale values was similar to that em¬ 
ployed by Hillegas. 

The measurement of ability in English Grammar. Char¬ 
ters’s Diagnostic Test in Language and Grammar for Pro¬ 
nouns. Charters collected more tlian twenty-five thousand 
errors that pupils make in using pronouns in their oral 
language. These were classified under forty heads; that is, 
there were only forty different kinds of errors in the use of 
pronouns in the total twenty-five thousand. The language 
part of the test consists of forty sentences. The pupils are 
required to write the correct form. This test is designed to 
be used in grades three to eight. In the grammar part of 
the test, which consists of the same forty sentences, they 
are required to give the reason for making the correction. 
The form of this test is illustrated by a few of the exercises 
given on the next page. It is recommended for use in the 
seventh and eighth grades. This test measures two abili¬ 
ties : (1) The ability to use correct forms of pronouns. The 
measure of this ability is his "language score” and is the 
number of the language exercises done correctly. (2) The 
ability to give the grammatical rule which tells which form 
is correct. The measure of this ability is his “ grammar 
score ” and is the number of the grammar exercises done 
correctly. 

Recording the scores. For this purpose a class record 
sheet with detailed directions is furnished with the tests. 

Recording scores for purpose of diagnosis. In order to 
obtain a diagnosis of the abilities of the pupils of a class, 
the form of tabulation which is partly shown in Fig. 38 is 
helpful. It gives in a compact form the record of each pupil 



8. Wk) do you want? 
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Fig. 39. Record Sheet tor Diagnosis 

Oharteia’a Dlagnoatlc Test In Language and Grammar. Exerclaea 1 and 29 are omitted 
beouuae they oia correct aentenoae. 
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on each exercise. With this tabulation l)efore liim the 
teacher can ilelenninc (1) wliat errors should he gh^en more 
emphasis and (2) what pupils are lacking in ability. Since 
tlie tost includes all the pronoun errors, the teacher may 
be sure that Ris i)upils have been tested comi)leteIy in this 
field. 

Standards. No standards are yet available for this test, 
but those desiring to use it may obtain the standards from 
tlie Bureau of Educational lle.scarch, University of Illinois, 
Urbana, Illinois, as soon as they have I>cen determined. 

Starch’s Punctuation Scale. Starch has devi.scd a punctu¬ 
ation scale, which consists of a number of sentences which 
the pupil is to punctuate correctly. The sentences are 
grouped in exerci.scs of gradually increasing difficulty of 
punctuation. The nature of the scale may be illustrated by 
lire following extracts. The pupil’s score is the value of the 
highest step which he does seventy-live jxir cent correct. 

Step 6 

1. We visited New York the large.st city in America. 

2. Everything lieiiig ready the guard blew his horn. 

3. There were blue green and rcrl Hags. 

4. If you come bring my book. 

Step? 

1. I told him but he would not listen. 

2. Concerning the election there is one fact of mucli importance. 

3. Tlie guests having dciiartecl wo clo.sed the door. 

4. The train moved swiftly but Turner arrived too late. 

Step 10 

1. A tall square building is located on State Street. 

2. Washington Irving whose personality was genial and charm* 
ing became very popular in England. 

3. You see Jolin how I stand, 

4. On the path leading to the cellar steps were heard. 
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Step IS 

1. I saw no reason for moving tlieiefore I stayed still. 

2. There ore three causes poverty, injustice and indolence. 

supie 

1. As in warfare a band of men though strong and brave indi¬ 
vidually is collectively weak if it is not well organized so a 
speech a report an editorial an essay any composition though 
its parts may be forcible or clever is weak os a whole if it is 
not well organized- 

standards. The following are tentative standards of 
attainment for the ends of the respective school years: 


Grade 

Score 

Seventh 

8.0 

Eighth 

8.3 


' No diagnosis obtained. Starch’s Punctuation Scale does 
not yield a diagnosis because he did not analyze the field of 
punctuation to determine the types of sentences requiring 
punctuation. In this respect, as well as in others, it differs 
from Charters’s Diagnostic Test in Language and Grammar 
described above. 

Measuring accuracy in copying. Copying is a phase of 
school work which receives little explicit attention. This is 
probably due to the assumption that pupils ore able to copy 
accurately because it appears to be such a simple activity. 
Copying bears a relation to written expression and to other 
school subjects as well. Themes are usually copied before 
being submitted to the teacher. In solving problems in 
arithmetic the quantities are copied from the text. In 
gathering information from references copying occurs. 

The Boston test. The following test of pupils’ ability to 
copy printed matter was ijrepared by a group of Boston ^ 
teachers: 

‘ Determining a Standard in Accurate Copying. (Boston Public Schools, 
■English, School Document no. 2,1016.) , 
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Directions fou Giving and Scoring the Test 

1. Read to the pupils the directions which are printed at tlio 
head of the selection tliey are to copy, hut give them no 
further help, For example, do not siiecify possible errors 
which may bo made. 

2. Pupils ought not to see the selection until they arc ready to 
copy it. Hence it should lie placed on the desk face down 
until tlie signal is given to begin woik. 

8. Every error shoiihl be check hI distinctly. 

4. The errors which were to be noted were as follows: In spelling, 
capitalization, punctuation, undotted “i’s,” uncrossed “t’s”; 
in omitting words, in adding words, in wrong words used, and 
in misplaced words. 

Dirccliona to Pu’pUa 

Copy in ink as much of the following selection os you can copy 
accurately in fifteen minutes without hurrying. Accuracy is mote 
Important than speed: 


Lmdenant Oulesa 

In this story a young British lieutenant, in a moment of extreme 
irritation, strikes a private soldier. The act is one that calls for 
dismissal from the Queen’s service. 'VVlint is the ofiiccr to do? Ho 
cannot send money to the soldier — who happens to be tlic redoubt¬ 
able Ortberis himself — nor can he apologize to him in private. 
Neitlier can he let matters drift. Ortheris, too, has his oivn code 
of pride and honor; he too is a “servant of the Queen”; but how 
is the insult to bo atoned for? The way out of this apparently hope¬ 
less muddle is a beautifully simple one, after all. The lieutenant 
invites Ortheris to go shooting witli him, and when they are alone, 
asks him, “to take oft his coat.” “Thank you, sirl” says Ortlieris. 
The two men fight until Ortheris owns tliat he is beaten. Then tlie 
lieutenant apologizes for the original blow, and tlic officer and pri¬ 
vate walk back to camp devoted friends. That fight is the moral 
salvation of Lieutenant Ouless,* 

Kinds of errors made. This test was given to 4494 first- 
year pupils in the Boston High Schools in November, 1914, 
* Bliss Perry, A Slvdy qf Prose PvAion. 
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and tlierefore may be considered to measure the ability of 
pupils completing the eighth grade. The results are both 
interesting and significant. The following is quoted from 
the Bulletin mentioned above; 

The errors noted consisted of nine diSerent kinds, and the 
number of each kind made in this test by 4494 pupils is shown by 


the following tabulation: 

Spelling. 5,829 

Capitalization.. 644 

Omitted words. 4,077 

Added words. 606 

Wrong words used. 840 

Misplaced words. 106 

Punctuation. 5,876 

Undotted “i’s”. 8,794 

Uncrossed t’a”. 606 

Total. 27,377 

Average errors per pupil. 6.64 


Misspelled words. The test consisted of 170 words, 106 of them 
different words. It is a notable fact that every word was mis¬ 
spelled by somebody. It is also interesting that 92.2 per cent of the 
words in the test are found in Jones’s Concrete Investigation of the 
Material of English Spelling.^ In spite of the fact that these are 
words commonly used by children in their writing, 11.8 per cent 
of them were misspelled more than 100 times. This does not mean 
that 11.8 per cent of the children missed these words, because one 
pupil might have missed the same word more than once. 

It is impossible to make any statement in regard to the average 
because many of the words occur in the selection more than once, 
and if mis.spelled by the same person each time it occurs it is 
counted more than one error. Some children spelled a word incor¬ 
rectly in one place and correctly in another. One boy spelled 
"lieutenant” wrong four out of five times, and spelled it a different 
way each time. Then, not all the children finished the entire selec¬ 
tion, and no record was kept of the exact number of words each 


* Published by the University of South Dakota. 
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wrote. However, 4494 pupils takbg the teat made 5829 errors in 
spelling alone, the number of errors for each word varying from 
1 to 1045. 

TJndottei “i’n” and unorosscd “I'a.” The error.s made by leaving 
the “i’a” undotted and the “t’s” uncrossed comprise about one 
tliird of the entire number of errons and are largely important be¬ 
cause of their value to legibility, as pointed out l)y Ayres. In con¬ 
nection with these errors, it is very noticeable that most of them 
were conliiicd to comparatively few i)upils. If a child showed a 
tendency to dot lua ‘'i’.a” and ero.sa his "t’s” in tlic first few linos, 
the chances were that that individual would liave but few errors. 
On tlie other hand, if the child made, many crror.s in the first part 
of the paper, there were many tliroiighout the copying. One boy 
went tlirough the entire pni>er without dotting an “i.” Many 
others dotted only a small part of them. 

The same test was given in Kansas City, Missouri, to 
the pupils in the seventh grade and in the first year of the 
high school. (Kansas City has only seven grades below 
the high school.) The average errors per pupil were 8.04 
in the seventh grade, and 0.83 in the first year of high 
sehool. 

Remedying the situation revealed. Wlien a teacher learns 
the specific language weaknesses of his pupils, he is then in 
position to apply more mtclHgently his .stock of methods and 
devices of instruction. In language, as in the case of the 
other subjects, the teacher mtist instruct individual pupils 
who are grouped together rather than groups of pupils. 
Piuthermore, each pupil siiould receive the instruction 
which he needs to correct his langu'ige errors. 

If pupils are weak in a language abilily, such as punctua¬ 
tion, the laws of habit formation apply. After being sure 
that he imderstands the ftmetion of tlie punctuation marks, 
a pupil must have practice in punctuating his own writing. 
This probably is not sufficient. Exercises for practice can 
be constructed by taking appropriate material and repro¬ 
ducing it without the punctuation marks. 
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Until a teacker recognizes definite and specific ends to be 
attained) tbere is certain to be a large degi'ee of dissipation 
of liis efforts. Perhaps one reason why language instruction 
50 often does not produce satisfactory results is that it is 
not directed toward the engendering of definite abilities. 
That our present standards of language are chaotic is indi¬ 
cated in the report of a recent investigation.^ 

Present standards for composition indefinite. Six com¬ 
positions were typewritten without any identifying marks. 
They were “graded” on the scale of 100 per cent by twenty- 
four eighth-grade teachers who were asked to follow certain 
typewritten directions. The six compositions were then 
“completely corrected so far as mechanical or measurable 
errors were concerned.” The corrected compositions were 
graded by the same teachers according to the same direc¬ 
tions. 

If the “mechanical errors” of the compositions were sig¬ 
nificant factors in determining the first set of marks, the 
second set of marks should be conspicuously higher. How¬ 
ever, this was not the case. For two of the compositions 
the average “grade” was less after the “mechanical errors” 
had been corrected. The individual marks show that some 
teachers consider form important, and that others tend to 
disregard it in marking a composition. 

Keeping a record of pupils’ errors. In teaching spelling, 
teachers have kept a record of pupils’ errors and have em¬ 
phasized these words in their teaching. In our consideration 
of spelling it was urged that teachers first ascOTtain what 
words their pupils were unable to spell correctly. This plan 
may be adapted to the teaching of other aspects of language. 
The teacher should ascertain the pupils’ grammatical errors, 
and then equip them with the rules of grammar which are 

’ Brownell, Baker, “A Test of the Ballou Scale of English Composi¬ 
tion"; in School and Society, vol. 4, pp. 938-42. 
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needed to correct them. This has been done on a large scale 
in St. Louis and Kansas City, Missouri. 

The point of view in locating errors and applying correc¬ 
tives is most Important. Perhaps the scales and tests de¬ 
scribed in this chapter will have fulfilled their most impor¬ 
tant function if they cause teachers to analyze and define 
“language ability” in more apecifi.c terms. It i.s believed 
that their use will tend to produce this rcsiJl, especilally such 
a test 03 Cliarlers’s Diagno.stic Test in Language and Gram¬ 
mar for Pronouns which is based upon an analysis of that 
field. Analysis of "language ability” and specific definition 
of the elements are greatly needed. Upon the accomplish¬ 
ment of these two things depends the constn:ction of more 
valuable measuring instruments in the language field and 
the scientific determination of methods and devices of 
instruction. 


QUESTIONS AND TOPICS FOR STUDY 

1 . Give the copying test to your pupils following the directions car&- 
fully. Do the results agree with your esLimote of Ujc ability of your 
pupils to copy? 

8, Keep accurate lists of the language errors of your pupils both oral 
and written. What are tlie rule.s wliieh arc necessary to eorrcct these 
errors? Are they the rules upon which you are placing the naost 
emphasis in your teaching? 

8. Do you have definite objective standards of attainment in English 
composition? Can you use the scales described in this chapter to es¬ 
tablish such standards? 

4. Do you tliink pupils would be helped by having definite objectivo 
standards of attainment established for them? 

6, Secure a copy of Willing’s Composition Scale and post it in the class¬ 
room. Have pupils measure their compositions witli it. 

e. Why is Chnrtors’a Diagnostic Test in Language and Grammar more 
helpful to the teacher tlinn Starch’s Punctuation Scale? 

7. What do you think of Chartcra’s method of determining what exor¬ 
cises to usa? Is it a good method? Why? 


‘ See report by W. W. Charters in the Sixteenth Yearbook (if the National 
Society for the Study of Education, part i. 



CHAPTER X 

THE MEASUREMENT OP ABaiTY IN GEOGRAPHY AND 
HISTORY 

Geography and history are different from the school 
subjects treated in the preceding chapters. Subjects such 
as reading, the operations of arithmetic, spelling, and the 
like are sometimes called “tool subjects” to distinguish 
them from such subjects as geography and history which 
are called “content subjects.” Silent reading is a tool which 
a pupil uses in studying geography and history. The opera¬ 
tions of arithmetic are tools which are used in solving 
problems. 

Several tests have been devised for both geography and 
history, and, although they are open to criticism, they are 
more effective as a measuring instrument than tests or ex¬ 
aminations prepared by the teacher. The questions have 
been very carefully selected, have been evaluated, and the 
tests have been standardized. In both geography and history 
there are a very large number of items of information. Some 
of these are important, while others are unimportant. 
Authorities agree on the importance of some facts; on 
others they disagree. Hence, the selection of the questions 
is very important. On page 10 we found that questions 
were not equally difficult, and hence it is important to have 
the amount of credit to be given for each question scien¬ 
tifically determined. Finally, pupils’ scores cannot be in¬ 
terpreted without standards. 

The criticism is frequently made, that while it is possible 
to measure “what a pupil remembers," it is not possible to 
measure his ability to answer “thought questions,” This 
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statement is not true. It is possible to measure the ability 
of pupils to think. However, it is very significant that inves¬ 
tigation has shown tliat there is a very definite connection 
between a pupil’s ability to remember and his ability to 
think. One investigator '■ in history showed tliat there was 
a very close agreement between a pupil’s score on a memory 
test and his score on a thought test. This result is just what 
we should expect when we recall that reasoning involves the 
use of facts and a person cannot reason effectively unless he 
has command of the necessary facts. The aiiplication of 
this relation between ability to remember and ability to 
think is that in using a memory test, we are also indirectly 
meosming the ability of pupils to think in the same field. 
For the most part tests in geography and history have been 
devised so recently that -we do not have proof of their value 
as we do in reading and arithmetic. However, certain ones 
of the available tests give promise of being lielpful to tlie 
teacher. In tliis chapter we will dcscril)e two tests in geog¬ 
raphy and one test in American history. 

I. Geogr.'ipiiy 

I, Courtis's Standard Tests in Geography for States and 
important cities of the United States.® This le.sL i,s explicitly 
designed to cover only two lopic.s of geography, but all 
teachers will probably agree that they arc important ones. 
The plan of the te.st is to provide each pui)il with an outline 
map of tl\e United States showing tlie boundaries of the 
several States. Each State is given a number. The first 
part of the test consists of answering for each State tlie 
question, “On the map above what is the number of 
.In the second part of the test the pupil is 

* Buckinglmm, U. It., “ Clorrclation bciwwn AI)ilily to Think and Abil¬ 
ity to Remember, with Special Herereiiec In Unilecl Slates History”; 
in School and Soaictj/ (April 11, 1917), vol. fi, p. 4.13, 

* Prepared in uoHp oration wlUi B. A. Barnes, .Supervisor of Geography, 
Detroit Public Schools. 
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asked to give the number of the State in which certain cities 
are located. The preliminary test which is given, so that 
the pupil may understand just what he is to do, is repro¬ 
duced in Fig. 40, to illustrate this type of test. 


rNSTnnoTioNa 

Write after each state the 
number printed in that state, 
on the map at the right For 
instance: Write 1 after Mich¬ 
igan. What number should 
be written after Ohio? 

In the same way, after each 
city write the number of the 
state in which that city ia 
located. Write 1 after De¬ 
troit. Wliat should be writ¬ 
ten after Chicago? 


STATE CITY 


QuMtlonB 

Number 


Qucitlons 

Nuiiibor 








8. Ohio? .. 












4. Illinois?.. 








- 










Fig. 40. lLi.na'niATiNa Codhtis’s Standabd Tust in Ghogeapht fob 

Sl'ATKS AND iMPOHTANr Cl’WBa OF THE UNITED STATES 
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Marking the test papers and recording the scores. De¬ 
tailed directions for marking the teat papers and for record¬ 
ing the scores are furnished with the test and hence need not 
be given here. 

2 . Hahn-Lackey Geography Scale. A different type of 
test has been devised by II. H. Hahn and E. II. Lackey. 
This scale consists of questions which were very carefully 
selected. The plan of selection is described as follows 

Since texts will be used by a large majority of teachers for years 
to come, our primary purpose wm to construct a scale for the test¬ 
ing of the teaching of geography from texf-books. But when we 
realizerl that not one but a number of texts are being taught, wo 
had to modify our plan. Our first moflification con.sisted of limit¬ 
ing our questions to the phases of geography treated m common 
by six modern texts. Then we found that some of these phases 
were treated more fully by some authors than they were by others. 
A second inodificaUon of our plmi was, therefore, necessary; 
uomcly, to select the common subject-matter, or, in other words, 
tlie csentials of subject-matter in. each phase. In the selection of 
the essentials of subject-matter, tlic common subject-matter in 
tliese texts was largely our guide, but we also checked our exer¬ 
cises by principles and minimum essentials os tlicy have been 
worked out by makers of geography curricula. (See 1014 and 1010 
Yearbook [of the National Society for the Study of Education].) 
Over six hundred questions and exercises were selected by tliree 
toacliers, covering tliis common sulqcct-matter. These exercises 
were then examined by tlic authors of the scale, first, with refer¬ 
ence to repetitions, and duplications were eliminated. They were 
next examined for language difficulty. The wording of many of 
the exercises was cliouged, some of them were actually tried out on 
children, and in many instances tcclmical expressions which would 
convey exact meaning to mature students of geography were elimi¬ 
nated and the ordmary language of clilldren suhstituted. This is 
particularly true of the exercises in tlic lower reaches of tlio scale. 
The exercises intended for the upiicr reaches of tlio scale were not 
freed from technical expression.s the meaning of which pupils ore 

1 I'roai an unpublished account of die derivation of the scale by the 
authors. 
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expected to know as evidence of geography ability. Thus we find 
such expressions in the scale as “the Fall Line,” “climate,” 
“continent,” “natural wonders,” “natural geographic barriers,” 
“agencies,” “cyclonic storms,” and many others equally as tech¬ 
nical. The exercises were examined, in the third place, as to their 
scope, as suggested before. Nothing was mcluded beyond the 
essentials of geography. Finally, the list of exercises was revised 
so that it contained about an equal number of memory and thought 
questions. 

These questions were classified according to difficulty by 
giving them to 1696 pupils in twelve schools in two States. 
A section of the scale is reproduced in Fig. 41. The num¬ 
bers at the top of the columns represent the per cent of 
correct answers which were given by the 1696 pupils. These 
per eents arc tentative standards. 

Using the scale. This geography scale is a classified list 
of questions from which the teacher can select questions 
for a test. Since the questions in any column are equally 
difficult, it is best to take the questions for a test from one 
column. These may be ^ven in the usual way by writing 
them on the board. It is better if each pupil is provided 
with a mimeographed copy with space left for writing in 
the answers. The teacher should not explain the meaning 
of any words used in the questions because the results will 
then not be comparable with the standards. Ten questions 
will make a test of convenient length and probably is the 
best number to use. 

Scoring the papers. When ten questions are used and all 
have been chosen from the same column, each one may be 
considered to have a value of 10 credits. This will make 
the total number of credits 100. For scoring the papers the 
authors have prepared a score card. The portion of it which 
applies to the section of the scale reproduced in Fig. 41, is 
given below. These directions must be followed if the result¬ 
ing scores are compared with the standards. The score of a 
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pupil is the sum of the credits which he earns on the list 
of questions. The class score is the average of the scores 
of the members of the class. 

What to accept and what to reject in scoring answers. 
Many of the exercises in the Ilalm-Lackey Geography Scale 
admit of only one answer; but the scale contains exercises 
to which the answers may vary. In order that the scoring 
of the answers by teachers of different Iwalities may he 
uniform and the scores he comparable with those of the 
scale, Uie authors have prepared a list of typical an¬ 
swers they accepted and typical answers they rejected in 
making the scale. In this list the answers to the exercises 
arc given in the order in wliich they occur in tlic position 
of the scale reproduced in Fig. 41. 

“F” means full credit; “I”’ means port credit; "N” means no 

credit. 

4£, Different kinds o£ meat was credited as only one kind of 
food, 

l.F. “Brazir'i “South America"; "Mexico”; “Central 
America.” 

103. F. "Hays fall more vertical”; ‘'Farther south”; "Nearer the 

equator." 

N, "Ocean hreezea"; “Gulf Stream." 

104. F. " Capacity for water “Can go a long limewilhout a drink.” 
18. F, “Let it down in the vall<'y.s or sea”; “Ixiave it on the 

bank”; “Form Islands"; “llrop it at the mouth”; "Drop 
it when the cutrent is not swift.” (Any answer that indi¬ 
cates tliat rivers take soil from one place and put it in 
another plac“c.) 

£9. F. Any two linos of work; as, “Plants grain anil harvests it”; 
"Raising cattle and farming”; "Raises crops atid milks”; 
"Farming and selling Uiing.s.” 

P, One lialf credit for only one line of work. 

98. F. “No food for horses”; “Too cold for liimse.s.” 

6. F. "Earth” “lamd” “Rwk” “SUnie” “Moimtaius”; 
"Sand”; “Plains”; “Plateaus.” (Any answer indicating 
a knowledge of the bed of the ocean.) 
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Pig. 41- A Section or the Hahn-Lacket Geography Scale. 
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19. F. “Out of tlie ground”; “Prom veins”; “Springs”; “From 
little atrcnins in under tire ground”; “From moisture in 
the ground,” (Any answer clearly implying underground 
source.) 

23. F. Any two. “Bring rain”; “Turn mills”; “Fresh air”; 
"Makes temperature equal”; “Makes pressure equal”; 
“Scatters seeds”; “Causes oeenn currents.” 

C8. F. “Good harbons”; “Commerce”; “Importing and export- 
ing goods”; “Trade carried on there.” 

47. F. Any two. “By railroad”; “Wagon”; “Mail”; “Ships.” 

48. P. Any two. “Railroad bridge”; “Boat”; “Wagon bridge”; 

“Fording.” 

67. F. Any two. “Fish”; “Navigation”; “Sport”; “Water¬ 
power”; “Drains the land.” 

39. F. Auy answer indicating a knowledge of the ocean as a 
source of vapor in the air; os, “Fills the air with vapor”; 
■‘Makes air moist.” 

21. F. “Winds”; “Breezes”; “Air”; “Atmosphere.” 

Interpreting the scores. Two things must be kept in 
mind if a satisfactory interpretation of the scores is obtained: 
(1) Tiie sLandard.s given at the head of the columns do not 
represent the exact per cent of correct answers obtained. 
For example, 50, the fourth grade standard for column R, 
represents values from 40.8 to 58.2. Thus, small differences 
between scores and standards are not significant. (2) The 
standards arc given in Lenns of a scale of 100 units or a per 
cent scale. It is also customary to use a per cent scale for 
reporting “school grades,” or at least for defining them. 
Some per cent, :ia “GO,” “70,” or “75,” is chosen as the 
“passing mark.” A score of 79 on a set of questions chosen 
from column S of thi.s scale does not mean “79 per cent” as 
a school mark. This score of 79 is above standard in the 
fourth and fifth grades. It is just standard in the sixth 
grade and below standard in the seventh and eighth grades. 

When a pupil has a score which is just standard, he is just 
an average pupil because the standard is an average score. 
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If five marks, such as A, B, C, D, and E (A being the high¬ 
est mark), are used, such a pupil would be given a mark of C. 
If “grades” are reported in per cents and 75 is the passing 
mark, a score of 79 when the standard is 79 should be trans¬ 
lated as about “85 per cent.” Scores above and below 
standard should be interpreted with tlie standard reijre- 
senting the average, 

II. American History 

Harlan’s Test of Information in American History. The 
items of information called for by this test are found in 
practically all American history textbooks, being based on 
the study by Bagley and Rugg of twenty-three textbooks 
to determine the content of American history.’ This in¬ 
sures the questions being well selected. The credit to be 
given for answering each question has been determined and 
a score card is fiunished with the test so that the marking 
of test papers may be uniform. The test consists of ten 
exercises. The first, fourth, and ninth are reproduced to 
illustrate their nature. 


Exercibb I 

At the right of the page arc the names of some men mentionerl 
in American history. Fill in blanks with tlie names which properly 
belong there. 

1, Araericn wag discovered by.... 

Score,..... near the close of the fifteenth century. Jefferson 

SS, The name of the man who is supposed to Cornwallis 

have discovered the Pacific Oceon is. William Penn 

3. The first President of the United States was Lafayette 
... Patrick Henry 


r Bagley, W. C., and Rugg, II. 0., The Content of Ammcan Ilhiory at 
Taught in the Seventh and Eighth Grades, (University of Illinois, School of 
Education, Bulletin no. 16, 1910.) 
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4.is the name of a dis- Columbus 

tinguished Trenohman tvUo aided the col- Benj, Fraaklin 
onists in securing their independence.. , . Washington 

6.surrendered to the John Cabot 

colonial troops at Yorktoivn. Balboa 

Exercise IV 

Tell the very first thing you would do under each of the following 
conditions; also what you would do next:^ 

1. It a neighbor were to present to you for your signature a 

Score. petition to have some man removed from public office, — 

What would you do first?. 

Would you sign the petition?... 

2. It a man imprisoned in the county jail for some serious crime 
should be taken out by a mob with the intention of hanging 
him, — 

What ought to be done first?. 

Then what?..... 


Exercise IX 

The following topics represent matters of importance in the his¬ 
tory of the United States. State definitely of what significance 
each has been. 

1. Articles of Confederation. 

Score.. 

2. Mason and Dixon’s line.. 


8. Monroe Doctrine 


4. The Tariff. 


Standards. The total amount of credit allowed for the 
ten exercises is 100. Over two thousand pupils in the seventh 
and eighth grades have been tested at the end of the respec¬ 
tive years. The median scores are: Seventh grade, 56; 
eighth grade, 86. 
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As in the case of geography, these standard scores are the 
scores which sliould be made by the average or median 
(middle) pupils. Consequently, when translating these 
scores into school marks, a score which is standard should 
be given the “school grade” which represents the average 
pupil. 

Diagnostic value of the test. The different exercises call 
for different tyi)C3 of information; dates, names, causes, 
meanings of historical terms, etc. By tabulating the credits 
earned on the different exercises in the way given for Char- 
ters’s Diagnostic Testa in Language and Grammar (Fig. 39), 
a teacher may learn which phases of history need additional 
emphasis. 

Other tests in geography and American history. Since 
tests in these two fields have l)cen devised only recently and 
have not been used sufRciently to determine which ones are 
most helpful to the teacher we list here other tests. Informa¬ 
tion concerning them may be obtained by consulting the 
»referencc given or by writing to the address. 

Geography 

1. The Ihfiton Tc4a. 'I'hc two te.sts of this series—^one 
on the United Stales and the other on Europe —• consist of 
well-chosen que.stions. Tlio relative difficulty of the ques¬ 
tions was determined upon the basis of the per cent of cor¬ 
rect answers. The testa were devi.scd in an effort to deter¬ 
mine (1) tlie character of achievement in geography, and 
(9) tlie possibility of scientific metisurement of educational 
results in geography. This significant comment is made: 
“The results show how inadequate the customary examina- 
tionor testin geography is to measure ability in geography.”' 

* Otography; A Rcporl on a Preliminary Atlempt to Measure Some Edu- 
caiional Reaidls. (Doston, Department of Eilucalional Investigation and 
Meaamement, Bullelin no, S, School Document no. 14, 1013; p. 38.) 
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S3. Buckingham’s Oeography Test. This test was devised 
for use in the siirvey of the Gary and Prevocational Schools 
of New York City. It consists of two sets of twenty ques¬ 
tions which were evaluated upon the basis of the per cent 
of correct responses.^ 

5. Starch’s Oeography Tests, Series A. The common ele¬ 
ments of five geography texts have been arranged in five 
parallel tests. The exercises of the tests are in the form of 
mutilated sentences.* 

4.. WUham’s Standard. Geography Tests. These are a series 
of tests arranged to test quickly and easily the pupil’s knowl¬ 
edge of certain geographical facts. The facts for the tests 
on the world are grouped under these heads: (1) geograph¬ 
ical divisions, (2) form and motion of the earth, (3) the 
hemispheres, (4) land and water forms, (5) homes of the 
races, (6) industries, and (7) largest dties.® 

6. Branom and Beams Completion Test for the Measure¬ 
ment of Minimal Oeographic Knowledge of Elementary School- 
Children. This test was very carefully constructed and ap¬ 
pears to have a high degree of merit. No standards have been 
published.'* 

History 

1. Buclcingham’s Tests. These tests were used in the sur¬ 
vey of the Gary and Prevocational Schools of New York 
City. They consist of two sets of questions which have been 
evaluated on the basis of the per cent of correct answers. 

1 Sovenleenth Annual Report of tlie City Superintendent of Schools. (New 
York City, 1014-15.) 

> Address Daniel Starch, University of Wisconsin, Madison, Wisconsin. 

• Witliam, E. C., “A Minimum Standard for Measuring Geography”; 
in American School Board Journal (January, 1915), vol i, pp. 13-14. 
Address E. C. Witham, Southington, Conn. 

* Seventeenth Yearbook of the National Soeiely for the Study of Education, 
port I, pp. 27-39. (Public School Publishing Company, Bloomington, 
Illinois, 1818.) 
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More recently Buckinghani has studied the relation between 
the ability to remember historical facts and the ability to 
use them. In this study specially devised tests were used.^ 
The Bell and McCollum Test. This test consists of a 
series of questions -which have been very carefully selected 
because of tlieir importance. The topics included are: 
(1) dates-events, (3) men-events, (3) events-incn, (4) his¬ 
toric terms, (5) political parlies, (6) dmsions of history, 
and (7) map-study. The test can be administered in a forty- 
minute period.* 

3, Siarcli's American Hisiory Teats, Series A. This test 
is based upon the facts and principles common to five mod¬ 
em texts. The exercises are in the form of mutilated sen¬ 
tences. Foiu duplicate forms are available.® 

QUESTIONS AND TOPICS FOR STUDY 

1, Wliat do you think of the method used in selecting the questions for 
tlio Iltihn-Iiackcy Geography Scale? Is it a good method? Why? 

2, Can WQ determino what pupils should know by examining textbooks? 
Why? In such a subiecl ns geography, how can you determine what 
pupils should know? 

5. What is n " tool subject ” ? A “content subject ’’ ? 

4. How is n score on the Hnhn-Lackcy Geography Scale to be inter¬ 
preted? 

B, Select ten questions from the llahn-Lackoy Geography Seale. In 
what ways do they form a better test than a list of questions you 
might prepare? 

6, How was Horlan’a American Ilistory Test made? Wlmt arc its 
strong points? Coraparo it with the usual history examination. 


^ SeverUeenih Annual Reporl of ihe CHy Supcrinie^uletii of Schools. (New 
York City, 1014-13.) 

’ Bell, J. C., and McCollum, D. F., "A Study of the Attainments of 
Pupils in United States History”; in Journal of Educational Psychology 
(May, 1917), vol. 8, pp. 237-^74, 

* Address Daniel Starch, University of Wisconsin, Madison, Wisconsin. 



CHAPTER XI 

EDUCATIONAL MEASUREMENTS AND THE TEACHER 

In Chapter I evidence was presented which showed that 
measurements of the results of teaching, both by teachers’ 
estimates and by examinations, were strikingly inaccurate. 
More accurate measurements of the results of teaching can 
be secured in two ways: (1) By using standardized tests, 
A number of these instruments have been described in the 
preceding chapters and the teacher has been told how to 
make the greatest use of the information obtained. (2) By 
introducing certain improvements into the making and 
using of examinations set by the teacher. Before presenting 
suggestions for making these improvements, it may be 
helpful to consider a question which may have occurred to 
some readers: What is the vahie of measuring accurately the 
results of teaching? The answer to this question will be pre¬ 
sented under two heads: (1) A common-sense answer, or 
logical reasons: (2) experimental evidence. 

(i) Logical reasons for the value of accurate measure¬ 
ments by means of standardized tests. It is a generally 
accepted principle that in any field of human endeavor the 
most eflScient results are attained when one has a definite 
aim to work for and instruments for determining from 
time to time how much has been accomplished. A definite 
aim makes it possible for the worker to direct his efforts 
toward the particular things to be accomplished, instead 
of scattering them over on indefinite field. Instruments 
for measuring results make it possible for the worker to 
know what he has accomplished and where he needs to 
place greater effort and where less effort. It is also possible 
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for liim to learn wliether the materials and methods he is 
using are effective and which materials and methods are 
most effective. 

This principle is the foundation of success in the busi¬ 
ness world. The merchant, manufacturer, or farmer who 
does not have a definite aim and who does not measure 
his accomplishment from time to time is most frequently 
a failure. Bankers measure the results of their business 
every day. Merchants take inventories once a year and in 
many cases more frequently, sometimes a partial inventory 
every day. They consider this procedure necessary for 
success. 

The teacher is a manufacturer. His raw material is the 
children. Textbooks, school buildings, equipment, libraries, 
and methods and devices of teaching are the “machines” 
or instruments which he uses to change tliis raw material 
into the finished product or educated boys and girls who 
are prepared to do their part in the life of the community, 
State, and Nation. Without definite aims the teacher cannot 
plan his work effectively. He does not know, except in an 
indeCnite or general way, what he is to do. If he has definite 
aims, but no instruments for measuring his results accu¬ 
rately, he cannot learn when he has attained his aims. Thus 
be is compelled to work in the dork. If he makes inaccurate 
measurements, but considers them accurate, he is in a still 
more serious situation. His efforts are almost certain to be 
expended unwisely. 

Evidences of the lack of definite aims. It may appear to 
some teachers that the aims for the several grades as stated 
in courses of study are sufficiently definite. In the case of 
reading it was pointed out on pages 82-85, that oral read¬ 
ing was soraeiiracs over-emphasized, while silent reading 
was neglected, and that in certain cases the rate of silent 
reading was not sufficiently emphasized. In tlie operations 
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of arithmetic the rate of work is sometimes neglected (see 
pages 2S and 25). Cases of irregular progress are shown in 
Figs. 119 and 122. When classes make irregular progress in 
ability to do the different types of examples, as is shown 
in these figures, the lack of definite aims is a contributing 
cause. 

Another type of evidence is given in Fig. 42.* This figure 
is di-awn by the method given on page 110, and shows five 
sets of median scores for rate and accuracy in Addition 
(Series B) in Grades four to eight: (1) Courtis Medians, 
(2) Medians for Cuyahoga County (Ohio), (3) Brook Park, 
(4) Rocky River, and (5) Shaker Heights. (The last three 
are three district schools in Cuyahoga County.) The broken 
line (----) connecting the small circles representing the 
Courtis Medians shows gradual and regular progress from 
grade to grade. The same condition is exhibited for Cuya¬ 
hoga County as a whole, but a distinctly different situation 
is shown for the three schools. In the fourth grade the 
Brook Park School is very low in accuracy. The fifth-grade 
pupils show a decided gain in accuracy, but almost no prog¬ 
ress in rate of work, wliile the accuracy median for the 
sixth grade is below that for the fifth grade. The rate of 
work for these three grades is approximately the same. 
From the sixth grade to the seventh marked progress in 
both rate and accuracy are shown and from the seventh to 
the eighth grade the progress is almost wholly in accuracy, 
A study of the lines representing the median scores of Rocky 
River and Shaker Heights reveals similar irregularities in 
the progress from grade to grade. This condition is prob¬ 
ably due in a large degree to the fact that the teachers did 
not have definite aims for the several grades and had not 

1 This figure is taken from the Third Annual Bulletin and School Direc-^ 
iory of Cuyahoga County {Ohio') School Districh p. 71, by County Superin¬ 
tendent A. G. Yawberg. 
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PiQ, 42, MEniAua in SrBBO end AcctniA«nr in Addition Trbt, Seihes I), 
rou l’uni,a oir Giiades 4 to 8 inolotive, hiiowino (^ouhtib’s Mb- 
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TUB CocNTV. Uatb on Vkrticajj Scale, AccuiiAcrr on Hdiuzontai, 
Scale. 


measured the results of their in.struction to learn to what 
extent these aims were being realized. 

Courses of study do not give definite working specifica¬ 
tions for teachers. Our present courses of study represent 
the efforts of tliose occupying supervisory positions in our 
school systems to provide teachers with specifications for 
their work. How well they have succeeded is illustrated by 
the following quotations from typical courses of study: 
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Fourth Grade 

Reading and Literature. Stories read and told to the class; 
Roman stories, American history stories relating to geography, 
selections from Greek and Teutonic mythology, and poems. 

A few choice selections of appropriate prose and poetry are to 
be studied, committed to memory, and recited or dramatized. See 
that the pupil stands on both feet and reads smoothly and confi¬ 
dently. Watch the voice of pupils; use breathing exercises; and 
avoid harsh, strained reading. Have pupils read many selections 
silently, then reproduce the thought aloud in order to develop the 
power of gaining and expressing the thought of the text. Aim to 
enlarge the pupil’s vocabulary, to help him master the thought 
content, and gain the power to read in a pleasing, well-modulated 
tone. Use much supplemental reading. Explain the purpose of 
the children’s department in the Public Library, and encourage 
pupils to read books therefrom. 

' Following these general directions, the selections to be 
read are specified; 


Third Grade: B Class 

Handwriting, Daily drill, lessons five, sk, or seven.' During 
the entire year tliese drills should be used for a few moments at 
tire beginning of each writing lesson. 

Beginning with lesson five, take the lessons in consecutive order 
to lesson thirty-five. 

After developing a letter with the class take, from the writing 
book, a word beginning with the same letter and use it for practice. 

If the letter is a capital, follow the word practice by using a 
sentence beginning with this letter. All words and sentences should 
be taken from the writing book. 

Grade Arithmetic 

Leading topics. The four fundamental processes with emphasis 
upon multiplication. 

Review. Regularly, constantly, and from the first. The addition 
combinations, subtraction, reading and writing numbers, simple 
fractions. 


> Reference to a Manual for Teachers, used in this school system. 
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Mukiplicalion. The tablca completed and made automatic. 
Problems with two-place multipliers. Rapid oral practice. 

Hirision. Short division with long division brace. Rapid oral 
practice. 

Fraclions. Simple fractions and mixed numbers as needed in 
actual practice on concrete form problems. Largely oral and 
objective. 

Concrete ’problems. One-step problems. 

Applied problems. Farm prwlucts, farm marketing, farm profits, 

Mcastircs, Quart, gallon, ixick, bushel, pound, ton, cord, etc., 
ns required by applied problems. 

In the fourth-grade cour.se of study for reading, nothing 
is said about tlie rate at which a pupil is expected to read 
orally or the rate and degree of comprehension of silent 
reading. The teacher is told to "enlarge the pupils’ vocabu¬ 
lary," but be is not told how ftmeh to enlarge it. In hand¬ 
writing nothing is said about the rate or quality of writing. 
In aritliincLic the multiplication tables are to be “completed 
and made automatic." This is indefinite because there are 
many degrees of automatization. "What one teacher would 
call automatic, another would not. “Rapid oral practice” 
is likewise indefinite. 

Definite si)eeiflctttioua for these subjects could be given 
by stating the rate and quality of work exi^ected of the 
pupils. For example, in handwriting the teacher would have 
a definite aim if he was told that fourth-grade pupils should 
be able to write memorized material at the rate of 50 letters 
per minute and with a quality of 50 as measured on the 
Ayres Scale. In ariUmietic the aim would be definite if he 
were told that fourth-grade piiplls should be able to write 
Hie answers to the multiplication combinations at the rate 
of 23 per minute. When the teacher has his aims expressed 
in this definite way, he still needs to measure results to learn 
to what extent he is realizing his aim, 

(a) Experimental evidence of the value of standardized 
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tests to the teacher. Several instances of the value of stand¬ 
ardized tests have been given in the preceding chapters. 
For reading, see pages 73 to 89; for arithmetic, see page 
151; additional evidence is given in Figs. 43, 44, and 45. 
In Fig. 43 a sixth-grade teacher in a small town gave 


uaitlon Sulitraotloii IftaMpltoBtloa SlTlBlfin 



Dotted Une September mediona. Solid lino (upper) April medians. Heavy solid lino, 
standard median scores. 


the Courtis Arithmetic Tests, Series B, in September, 
1917. The condition revealed is shown by the lower line 
in the figure. The standards or the definite aims to be 
attained are represented by the heavy solid line. The re¬ 
sults of the teacher’s efiorts are shown by the upper line 
which represents the median scores for April, 1918. This 
teacher knew what her pupils could do at the beginning 
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of tlie year and the standards which were to be attained. 
She had the satisfaction of knowing that these had been 
attained. 

In Cleveland, Ohio, spelling was tested in May, 1915. It 
was again tested in May, 1917. In Fig. 44 the “efficiency” 
of s])elling in certain of the buildings is showing for these 
two teats. The broken line represenUs the “efficiency”^ for 
the test in May, 1915. The solid line represents the “effi¬ 
ciency” for the test in May, 1917. The significant thing in 
this illustration is the material improvement in spelling 
“efficiency ” of those buildings which had low average scores 
in 1915. This suggests that when a teacher knows that he is 
not seeming standard results, he is likely to increase the 
effectiveness of his instruction. 

In the city of Boston standardized tests in arithmetic 
were given in 1912 in twenty-nine schools and have been 
given at least once each year since. In Fig. 45 these ore 
called Group A Schools. In the Group B Schools the stand¬ 
ardized tests in arithmetic were given first in 1918 or 1914. 
Group C includes those schools in which the results of in¬ 
struction in arithmetic were measured for the first time in 
1015. Group A represents 18,391 pupils, Group B, 15,241 
pupils, and Group C, 11,830 pupils. In May, 1016, standard¬ 
ized tests in arithmetic (the Comtis, Series B) had been 
used in Group A for tliree consecutive years, in Group B 
for one or two years, and in Group C they were being given 
for the first time. 

We have here, therefore, on opportunity to study the 
effect of using such tests. If tlie tests are helpful to the 
teacher, those schools in which they have been used for three 

‘ ‘‘Effidcncy” means here the quotient of the avemge aeore divided by 
the standard given by Ayres on his Spelling Scale. Since these standards 
ore lower than the average scores in certain cases those quotients are 
above 100. 
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years should show the best results and those in which they 
have been used for one or two years should stand above 
tliose in which they were given for the first time. Fig. 45 

Dnaibor of azamplea attemptel 
0 8 4 6 8 10 la 14 16 

’ ' Addition 



Subtraotion 



Multlplloation 


A| 

B| 

0 | 



Fio. 45. SnowiNO Effect of CoN'nwTjous Use of CotmTis’s Standaud 
RBS jiAJicn 'fEaTS, SKntr.8 H. in Boston, EiunTU Giiade, 1016 

Grqup A Mhoold conllnuom luw for Ihwa ycara. Group 1) npliooU tuo for one to two yean. 
Group C acbeolfl not given until thu record waa itccurod. i/lfler Ballou.) 

represents the median numlier of examples attempted by 
the eightli-grade pupils in each of tlie three groups of schools. 
In every case the Group A Schools have the highest medians 
and the Group B Schools stand above those of Group C. 
The median scores for accuracy are not represented, but 
they show the same condition. Thus, this figure shows that 
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in the case of the eighth grade superior results in the opera¬ 
tions of arithmetic are attained by those schools in which 
standardized tests are used. The results for the other grades 
in Boston are not so striking, but they furnish additional 
evidence that it is helpful to measure the results of instruc¬ 
tion accurately. 

Making examinations yield more accurate measurements. 
In Chapter I the following criticisms were made of the 
measurement of the results of teaching by examinations: 
(1) The questions cover a wide range of topics making the 
“grade” have no definite meaning. (2) The questions are 
generally not equally difficult and the same amount of credit 
should not be given for answering different questions. The 
judgment of a teacher in regard to the amount of credit 
which should be given for answering a question correctly is 
not reliable. (3) Teachers do not mark examination papers 
accurately. (4) The pupil’s rate of work is usually neglected 
even in those subjects where it is important. (5) Standards 
are not available for interpreting the measures. 

It is not possible for the teacher to eliminate entirely the 
defects enumerated by these criticisms, but it is possible 
for him to reduce them. Greater care in choosing and fram¬ 
ing the questions will materially reduce the first defect men¬ 
tioned above. Catch questions should always be avoided. 
Also the question should be stated so that the pupil will 
understand what is called for. The questions should be 
important. Unimportant facts should not be called for unless 
there is some particular reason for doing so. 

The amount of credit to be pven for answering a question 
correctly cannot be accurately determined, but a helpful 
rule to follow for questions which are approximately equal 
in importance is that the most credit should be given for the 
most diflBcult question and the least credit for the easiest. 

Both of the above suggestions will tend to increase the 
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accuracy of tlie marking of examination papers. In addition 
a systematic plan will materially reduce tins source of error. 
Kelly‘ describes tlic following experiment; Six fifth-grade 
teachers gave a uniform examination in arithmetic to their 
pupils. Each teacher marked the papers for her own pupils, 
but did not record the marks on the papers. The superin¬ 
tendent asked a teacher, who was unusually systematic in 
marking examination papers, to prepare a definite plan for 
marking these papers. After she had done so, she marked 
all of the papers in accordance with this plan. Then the 
teachers who had first marked the papers marked tliem a 
second time following her plan. This provided two marks 
for each paper by the classroom teacher, the first without 
following a systematic plan, and the second using a definite 
plan. Each of these marks was compared with the mark 
of tlie teacher wlio marked all of tlic papers, In Table XXIV 
tlie six teachers are designated by the letters A, B, C, D, E, 
and F. The table is read as follows: When no systematic 
plan was followed, teacher A marked one paper 10 to 20 
points lower than the “judge,” one paper 7 points lower, two 
papers 4 points lower, two papens 2 points lower, agreed 
with the “judge” on one paper, etc. The differences be¬ 
tween tlie marks given when the classroom teachers hod no 
systematic plan and when tliey followed such a plan ore 
very striking. In the first instance tlio marks assigned by 
the teachers agreed with those assigned by the “judge” in 
only 6.5 per cent of the coses, while in the second instance 
they agreed in 03,5 per cent of the cases. Thus the ex¬ 
periment shows that with a systematic plan for marking 
papers, the marks will be more accurate. 

The rate at which tlie pupil works can easily be measured 
in such subjects as reading, handwriting, and the operations 
of arithmetic. It is only necessary to place a time limit 
* Kelly, F. J„ Tcaohert' Marks, p. 84. 
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upon the examination such that no pupil will answer all of 
tlie questions. The number of questions answered will be 
a crude measure of his rate of work. 


Table XXIV. Distbibutions of Diffebenoes between Two 
Sets of Tbachbbs’ Mabkb on Eifth-Gbade Arithmetic 
Papehb — First, without any Effort to unift the 
Methods used, and Second, by a Common Standard 
(after Kelly) 
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The lack of standards can be partially remedied by having 
other teachers give the same examination to other pupils 
of the same grade. Where this is not possible, the teacher 
should verify what he considers a satisfactory standard by 
using standardized tests occasionally. If the standardized 
tests show a class to te near the standard, the teacher may 
conclude that his standard is satisfactory. If the work of the 
chiss is .shown to 1)C unsatisfactory then the teacher should 
conclude that his standards are too low unless her examina¬ 
tions have also shown the doss to be doing a low grade of 
work. 


QUESTIONS AND TOPICS FOR STUDY 

1, How mny cxntninatiom bo made more accurate measuring instru¬ 
ments? 

2, Do you tliink tlmt cxmninationB have functions other than tlmt of 
measuring the abilities of pupils? If so, what are they? 

3, Rci>cat the experiment dcseriljcd on page 218 and oomparo your re¬ 
sults with those given in Talde XXIV. 

4, Why is n general aim not sulficicnl? 

5, Wlittt are the oljjcclious to our present courses of study with respect 
to the statement of aim? 

0, How can standardized tests be used in setting tlic aim for the teacher? 

7. Crilieia; your course of study. How could you make use of standard- 
ijH!(l testa in improving it? 

8. Why slioiild teachers use standardized tests? (dive all of the reasons 
you (Sin think of.) Do they rtsquiru more time on the part of tlie 
teacher Limn similar teals ho might prepare? 



CHAPTER Xn 

SUMMARY 

The use of standardized tests by teachers may be sum¬ 
marized under the following steps. 

1. Selection of a test to use. For the most part teachers 
should accept the advice of experts in selecting a test. How¬ 
ever, it is well for teachers to ask these questions about a 
test: (1) Has it been widely used or is it likely to be widely 
used in the near future? (2) How much time is required to 
give the test, to mark the papers, and to record the scores? 
These points are very important. If the test has not been 
widely used or there is no prospect of its wide use in the near 
future, reliable standards will not be available. Also the 
general use of a test indicates that it has been found helpful 
to teachers. If a test requires a large expenditure of time, a 
teacher is not likely to receive adequate returns for the time 
spent. In general a teacher should choose a test which is 
simple to use and which requires only a moderate amount 
of time. 

2 . Giving the test. In giving a test to a class the teacher 
should follow tlie directions. If this is not done, compari¬ 
sons of the resulting scores with the standards will not be 
valid. Also the teacher should bear in mind that his purpose 
should not be to secure as high scores as possible, but to 
secure a true measure of the abilities of his pupils. In order 
to do this the pupils must not be excited or urged to work in 
an unnatural way. 

The manner in which the test is presented to the pupils 
affects the scores. The purpose of measurement is defeated 
if the test is presented to the pupils in such a way that their 
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response is unnatural. For example, in handwriting, if the 
pupils write at an unnatural rate the quality of their hand¬ 
writing will be affected. 

3. Marking the test papers. Explicit directions and score 
cards are generally jjrovided for doing this. Here also the 
teaclier must follow the directions. If he does not, a valid 
comparison cannot Ixs made with the standards. In the case 
of a few testa, the paiiers are marked by the pupils as the 
teacher reads the correct answers. This can he done in the 
case of tests in the operations of arithmetic, in certain read¬ 
ing tests, and in spelling. Courtis advises that this plan be 
followed in order to save time which may be used in the 
interpretation of scores. In the case of handwriting and 
composition, the teacher should equip himself for accurate 
rating of papers by systematic training. 

4. Recording the scores and calculating class scores. 
Blanks for recording the scores are usually furnished with 
the tests. When tliey arc at hand, this step is very simple 
after the teacher has had a little practice. 

5. The interpretation of scores. In interpreting both in¬ 
dividual and class scores, standards are necessary. Many 
people understand facts more easily when they are repre¬ 
sented graphically. Hence, it is well to employ some means 
of graphical representation. 

6. Correction of the defects revealed by the test. The 
correction of the defects revealed by the test is tlie culmina¬ 
tion of the preceding steps. It is in tliis step tliat tire value 
of standardized tests is realized. Without tliis step standard¬ 
ized tests become mere “playlliings*’ and their use cannot 
be justified. The situation created is similar to that which 
would exist if a physician examined a patient carefully and 
determined the nature of his ailment, but did not prescribe 
any remedial treatment. In our zeal to convert teachers to 
the acceptance of the principle that the measurement of 
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certain results of instruction is possible, there has been a 
tendency to overlook this step. In fact some have even said 
that they were content to apply the tests and reveal to the 
teachers the shortcomings of Uieir work. These persons 
would leave to the teachers the difficult problem of remedy¬ 
ing the defects. As a result not a few teachers have failed 
to see in tlie tests anything more than a new “plaything,” 
which they might use to secure material for a paper to read 
at a teachers’ association or to arouse the interest of their 
pupils. Such teachers have expressed their approval of the 
tests when their pupils’ scores were high, and have consid¬ 
ered the tests unsatisfactory when the scores were low. 

In order to prescribe the best corrective instruction the 
teacher needs to have as much information as possible. 
Hence, the need for diagnostic tests and for examining the 
test papers to learn of the pupils’ errors. Diagnosis requires 
time, but it is justified by making possible tlie planning of 
more effective corrective instruction, 
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A sample package of tests. It will be helpful to a teacher 
in reading this book to have at hand sample copies of the tests 
described in it. In a few eases it is almost necessary to have a copy 
of the test in order to understand the discussion of its use. Believ¬ 
ing that teachers would appreciate the opportunity of being able 
to secure all of the tests from one address, the author has assembled 
packages containing one copy of the testa marked with a star below. 
The other tests have been either reproduced in the pages of this 
book or described so fully tliat a copy is not needed in order to 
understand the test. A sample package will be sent postpaid upon 
receipt of a post-office money order or a check for 55 cents. Do 
not send stamps. Coins may be sent at sender’s risk. Address 
"Walter S. Monroe, Bureau of Educational Research, University 
of Illinois, Urbona, Illinois. 

All of the tests listed in the following table may be obtained 
from the author of this book by addressing him at the Bureau 
of Educational Research, University of Illinois, Urbana, Illinois. 
They may also be obtained from the respective publishers. A 
number of the testa arc carried in stock by other distributing 
centers and one will find it helpful to order these tests from 
the distributing center in hia state, if tlicre is one. In addition 
to supplying the testa the Bureau will also render other impor¬ 
tant service. If their state has no Bureau, teachers may send 
their order to the nearest one. The prices when ordered from 
tire Bureau are generally the same as when ordered from the 
publisher. 


DisTRiDurma Centebs 

Bureau of Educational Research, University of Illinois, Urbana, 

m. 

Bureau of Cooperative Research, Indiana University, Bloom¬ 
ington, Indiana. 

Educational Extension Service, University of Iowa, Iowa City, 
Iowa. 
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Bureau ot Educational Mcasurementa oud Standards, Kansas 
State Normal School, Emporia, Kansas, 

Bureau of Codi)erative Research, University of Minnesota, 
Miimeapoli.s, Minnesota, 

In Uic table bdoiv detailed information about the tests described 
in the preceding chapters is given. One not familiar Vfith ordering 
tests should study this tabic carefully in order to be able to ask for 
just wliat is needed. In some cases the necessary directions and 
record sheets are furnished by the publisher, but this is not true 
in all cases. When it is not done, the one ordering must ask for 
the number of these accessories desired. 

Very important, In ordering tests of which one copy is needed 
for each pupil always give tlic nuralw of pupils in each grade. This 
is important Imusc some of the series have different tests for the 
different grades. 

Prices. Because the cost of both paper and printing is changing 
80 rapidly it is not possible to quote prices for the tesla listed here. 
However, none of these tests arc published os a commercial enter¬ 
prise, Therefore a purchaser may be certain that the price charged 
wdl be reasonable. If it is desired to know the price before placing 
an order, address the publisher or one of the distributing centers 
named above. 
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School, 
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Brief directions for using the 
scale are printed on it. Explicit 
directions for scoring the test 
papers are printed separately 
and furnished 'vrith the scale. 
There is no class record sheet 

Directions for giving the test, 
for scoring the papers and for 
handling Se scores are printed 
Kparately. One copy is needed 
for each person giving the test. 
Class Record Sheet, one copy 

1 is needed for each class. 
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18. Hahn- 
Lackey 
Geom- 
phyScale. 

*19. Harlan’s 
Test of 
Informa¬ 
tion in 
American 
History. 


INDEX 


A-dams, John, 170. 

Analytical diagnosja in arithmetic, 
138. 

Aiithmetio: Courtla Standard Re- 
aeoroh Testa, Series B, 97 ff., 119 
£E.; Monroe’s Diagnoatio Tests, 
109, 131 flf.; Cleveland Survey 
Tests, 161; Monroe’s Standardized 
Reasoning Tests, 164 Stone’s 
Reasoning Test, 173; Starch’s 
Arithmetical Scale A, 174. 

Arithmetic, types of examples. 111, 
116. 

Arithmetic, vocabulary in, 103,105. 

Ashbaugh, E. J., 129, 221. 

Ayres, L. P., 176,178,208, 221. 

Ayres’s Handwriting Scale, “ Gettys¬ 
burg Edition," 207,209 ff.; Ayres’s 
Handwriting Scale, "Three-Slant 
Edition,” 208, 

Ayres’s Measuring Scale for Ability 
in Spelling, 176 ff„ 187-89, 

Bagley, W, C., 262, 

BaUou, P. W., 180. 

Bell and McCollum History Test, 
266. 

Boston Copying Teat, 249. 

Boston Geography Tests, 204. 

Branom and Reovia Completion 
Teat for Geography, 266. 

Dreed, P. S., 209, 244. 

Breed and Prostic ComposiUon Scale, 
244. 

Brownell, Baker, 253, 

Buckingham, B. R., 10, 266. 

Buckingham’s Geography Test, 266, 

Buckingham’s History Test, 206. 


Charters, W. W., 280,264. 

Charters’s Diagnostic Test in Lan. 
guage and Grammar, 246 ff. 

Chase, Sara E,. 106. 

Cleveland Survey Tests, 161. 

Comin, Robert, 11, 

Composition: Willing’s Scale for 
Measuring Written Composition, 
236 ff.; Nassau County Supple¬ 
ment, 243; Hillegas Composition 
Scale, 244; Thorndike Extension 
of the Hillegas Scale, 244; Harvard- 
Newton Composition Scale, 244; 
Breed and Prostic Composition 
Scale, 244. 

Corrective instruction! In reading, 

68 ff., 66 ff., 72 ff., 86, 86 ff.; jn 
arithmetic, 121,123,124,128,131, 
136, 189 ff„ 145 ff., 168-69, 168, 
173; in spelling, 192 ft,; in hand- 
writing, 224 ff., 228, 231 ff. 

Counts, George S., 144. 

Courtis, S. A., 107, 111, 138 ff„ 182, 
193. 

Courtis’s Silent Reading Test No. 2, 
29 S.. 46 ff., 82 S. 

Courtis’s Stondard Practice Tests, 
136. 

Courtis’s Standard Research Tests, 
Series B, 97 ff.; limitations of, 114. 

Courtis’s Standard lests in Geog¬ 
raphy, 266 ft. 

Diagnosis: in arithmetic, 119, 122, 
123,124 ff., 128 ff., 138 ff., 167 ff., 
160 S., 168 ff.; in reading, 63 ff., 66, 

69 ff., 82 ff.; in spelling, 190 ff,; in 
handwriting, 212 S., 231 ff,; in 
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language and grammar, Wfi; in 

I history, 204. 

Educational measurements, value of, 

20r (T. 

Elliott, E. C., 8, 

Errors in arithmetic, 142 ff. 

Errors in spelling, 10*1 ff, 

Fordyoe, Charles, 1B2. 

Freeman, F. N., 108, 109, 212, 214, 
213, 233, 

Praeman's IIondHTlting Scale, 212. 

FtosUc, F. W., 244. 

Geography: Courtis's Standard Tests 
in Geography, 230 If.; Ilatin- 
Lockey Geography Scale, 238 ff.; 
Boston Geography Teats, 204j 
Buckingham's Geography Test, 
205; Starch's Geography Tests, 
Scries A, 205; William's Standard 
Geography 'Tests, 205; Branom 
and Ileavis Completion Teat for 
Geography, 205. 

Gist, Arthur S., 142, 

Gray, C. T., 210. 

Gray, W. S., 07. 

Gray's Oral Heading Test, 30 ff. 

Gray's .Score Cord for Ilandwrillng, 
210 If. 

Gray’s Silent Reading Tests, 07. 

Haggerty, M. E., 40. 

Hahn, II. H., 258. 

Halin-Loekcy Geography Scale, 
258 8, 

Handwrithig; Ayrcs’sSoalc, "Gettys¬ 
burg Edition,” 208 8.: Freeman’s 
Scale, 212; Gray's Score Card, 
210 8.; measurement of rate, 
203 8., measurement of quality, 
207; standards, 219 8. 

Harlan's Test of Information in 
American History, 262 3 , 


Hnrvnrd-Ncwton Composition Scale, 
244. 

Ilillegas Composition Scale, 244. 

History: Harlan's Test of Informa¬ 
tion in American History, 202 8.; 
Buckingham’s History Test, £05; 
Bell and McCollum History Teat, 
200; Starch's American History 
Tests, Scries A, 200, 

Hollingworth, Leta S., 190,107. 

Johnson, P. W., 4. 

Jones, N. P., 170. 102. 

Judd, C. H., 07, 73, 70, 84, 225. 

Kallom, Arthur W., 109,144,197, 

Kelly. P. J., 3, 0, 278. 

King, W. I., 106. 

Koos, L. V., 222. 

Lackey, E. H., 258. 

Language and Grammar; Cliarters’a 
Diagnostic Test in laitiguage and 
Grammar, 246; Starch's Punctua¬ 
tion Scale, £'18-49; Boston Copy¬ 
ing Test, 240. 

Lewis, E. E., 223. 

Lull, II. G., 201. 

Median, calculation of, 20,36,102 8, 

Monroe, Waller S., 100. 

Monroe’s Diagnostic Tests, 100. 

Monroe’s Stundardiaed Reasoning 
Tests, 164 8. 

Monroe’s Standardized Silent Read¬ 
ing Tests, 22 8,, 43 8., 51 8. 

Monroe’s Timed-Sentence Spelling 
Test, 183, 180. 

Nassau County Supplement, 243. 

Nutt, H. W., 225. 

Otis, A. S., 180,181. 

Race, Henrietta Y., 49. 
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Reading: Monroe’s Standardized Si- 
ient Reading Tests, ii S.; Cour¬ 
tis’s Siient Rending Test No. 2, 
29 £F,; Thorndike’s Visual Vocabu¬ 
lary Scale, 36 II.. 49; Gray’s Oral 
Reading Test, 39 ff49-51; Thorn¬ 
dike’s Seale, Alpha 2, for the un¬ 
derstanding of sentences, 64. 

Reavis, C. W., 233. 

Rugg, H. 0., 202. 

Rural Schools, use of teat in, 26, 32, 
88 ff., 91, 99-100, 137. 

Scores, good arrangement of, 26. 

Sears, J. B., 194. 

Smith, James H,, 161. 
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